Job description
Position - Data Engineer
Location - Atlanta, GA
Experience - 7+ Years
Type - W2 Contract
Job Description - This role plays a critical role in building and enhancing Databricks platform for client's Data and AI usecases.
Responsibilities: This role will Implement Data and AI usecases on Databricks platformKey Skills: Databricks , Data Engineering , Cloud
- Data Engineering & Architecture: Databricks Lakehouse, Lakehouse Architecture, Medallion Architecture (Bronze/Silver/Gold), Data Modeling, Data Warehousing
- Databricks & Spark: Apache Spark, PySpark, Databricks SQL, Delta Lake, Delta Live Tables (DLT), Unity Catalog, Databricks Notebooks, Databricks Workflows/Jobs
- Data Integration & Processing: ETL/ELT Development, Data Pipelines, Batch Processing, Streaming Processing, Structured Streaming, APIs, JSON
- Performance & Governance: Performance Tuning, Optimization, Delta Optimization, Partitioning, Z-Ordering, Data Quality, Data Validation
- Cloud Platforms (Azure/AWS/GCP): Azure Data Factory, ADLS Gen2, Synapse, Key Vault; AWS S3, Glue, Lambda, IAM, Redshift; GCP Cloud Storage, BigQuery, Dataflow, Pub/Sub Programming & DevOps: SQL, Git.
Apply for this job
You'll be taken to the employer's application page.