Job Description

Data Engineering & Workflow Orchestration

Cloud Orchestration Platforms Storage

• Experience with one of the Below Cloud Platforms Platform Orchestrators Deployment Tools
• Cloud Providers Google Cloud Platform GCP AWS Microsoft Azure
• Orchestration Kubernetes
• Deployment Spinnaker Helm Charts

Data Engineering Technologies Workflow Orchestrations

• Experience with one of the Below Data Engineering Technologies and Workflow Orchestrators
• Data Pipelines Processing Apache Spark Apache Beam
• Workflow Orchestration Google Cloud Composer Airflow
• MLOps Machine Learning Operations

• Model Deployment Monitoring. Experience with deploying machine learning models using tools like TensorFlow, Serving TorchServe or MLflow
• Model Versioning Experiment Tracking Proficiency in using tools like MLflow, DVC or TFX for managing model versions and experiments
• Continuous Integration for ML Implementing CICD pipelines specifically for machine learning models automating training deployment and monitoring workflows
• Scalability Resource Management Understanding of distributed training resource scaling and automated model retraining
• DevOps CICD
• CICD Tools GitHub Actions or TeamCity