Job Description

The Data Platform Specialist is responsible for designing, developing, and overseeing scalable, secure, and high-performance cloud-based data platforms that support efficient data storage, processing, and analytics. The role ensures alignment with organizational objectives, data governance standards, and emerging technologies to enable data-driven decision-making and innovation.

This role also involves developing AD Airports’ cloud security architecture and standards, ensuring that the Azure cloud environment and hosted applications comply with security policies, standards, and best practices related to IaaS and PaaS cloud security.

Responsibilities

• Design, develop, and maintain secure cloud landing zones with embedded security controls.
• Develop and maintain the overall architecture of cloud-based data platforms, ensuring scalability, high availability, and fault tolerance.
• Design and implement data ingestion, integration, and ETL/ELT pipelines for structured, semi-structured, and unstructured data.
• Evaluate, recommend, and integrate cloud-native tools, frameworks, and services to meet business and technical requirements.
• Establish and enforce best practices for data governance, compliance, and security, ensuring adherence to standards such as GDPR, HIPAA, or other relevant frameworks.
• Monitor and optimize platform performance, including query execution, storage usage, and compute resource allocation.
• Collaborate with data engineers, business analysts, data scientists, and IT teams to gather requirements and align the platform with business goals.
• Design cost-efficient solutions using cloud billing and resource optimization techniques.
• Enable both real-time and batch data processing using appropriate cloud services and architectural patterns.
• Define and implement disaster recovery, backup, and data retention strategies to ensure data integrity and availability.
• Maintain comprehensive documentation of architectures, processes, and best practices.
• Mentor and upskill team members on cloud, data platform, and security technologies.

Requirements and Skills

Education & Certifications

• Bachelor of Engineering (mandatory); preference for a Master’s degree in Computer Science or Computer Applications.
• Microsoft Cloud certification with a security specialization (AZ-500, MS-500) or equivalent.
• Overall experience of 9 years, with at least 6 years in a relevant role.

Technical Skills & Experience

• Strong experience in cloud security and on-premises software security (e.g., security engineer, security architect, or DevOps engineer with security focus).
• Hands-on experience with major cloud platforms such as AWS, Azure, or Google Cloud and their data services (e.g., Azure Synapse, AWS Redshift, Google BigQuery).
• Proven expertise in designing data architectures, including data lakes, data warehouses, and lakehouse solutions.
• Proficiency in building scalable ETL/ELT pipelines using tools such as Apache Spark, Azure Data Factory, or AWS Glue.
• Experience with big data and streaming technologies such as Hadoop, Apache Kafka, Databricks, Kinesis, or Pub/Sub.
• Strong knowledge of modern database technologies, including NoSQL (MongoDB, Cassandra) and relational databases (PostgreSQL, MySQL, Oracle).
• Deep understanding of query optimization, data partitioning, indexing, and cost-efficient resource allocation.
• Experience with cloud-native architectures, including serverless computing, containerization (Kubernetes), and microservices.
• Familiarity with monitoring, CI/CD pipelines, infrastructure-as-code (Terraform, CloudFormation), and DevOps practices.
• Functional expertise in data governance frameworks, role-based access control, encryption, and compliance standards such as GDPR and CCPA.

Core Competencies

• Analytical Thinking & Problem Solving
• Collaboration & Stakeholder Engagement
• Adaptability & Continuous Learning
• Accountability & Ownership
• Cloud Data Platform Management
• Data Integration & Pipeline Development
• Database & Query Optimization
• Data Security & Compliance