GenAI Customer Engineer / Solution Architect

Job Summary

We are seeking a PySpark Developer with strong experience in Python, ETL, and Databricks to design, build, and optimize scalable data pipelines. The role involves processing large datasets, developing data transformation workflows, and implementing data engineering solutions on the Databricks Lakehouse Platform.

Required Technical/Functional Skills

• PySpark

• Python

• Databricks

• ETL

• Hadoop

• AWS

Roles & Responsibilities

• Design, build, and optimize scalable data pipelines.

• Process large datasets using PySpark.

• Develop efficient data transformation and ETL workflows.

• Implement data engineering solutions on the Databricks Lakehouse Platform.

• Support reliable and scalable data processing requirements.

Preferred Skills

Experience with the following is preferred:

• AWS, Azure, or GCP

• SQL

• Delta Lake

• Data pipeline and PySpark performance tuning