Job Description
Job Title: Data Engineer with Gen AI
Location: Dallas, TX
Job Type: Contract W2
Key Responsibilities:
- Design, build, and optimize scalable data pipelines and workflows for processing large datasets.
- Collaborate closely with Data Scientists to facilitate model development, training, and inference processes.
- Integrate and leverage Generative AI technologies to enhance data processing, feature engineering, and model development workflows.
- Write idiomatic and efficient Python code, leveraging the latest features of Python 3.11+.
- Ensure data integrity, quality, and availability across various systems.
- Implement and maintain best practices in data architecture, security, and governance.
Qualifications
Required Qualifications:
- Strong proficiency in Python, particularly idiomatic use of Python 3.11+ features.
- Proven experience as a Data Engineer working on large-scale data processing systems.
- Demonstrated experience supporting Data Science workflows (e.g., feature engineering, model training, inference pipelines).
- Experience with Generative AI frameworks and tools for data augmentation or model development.
- Solid understanding of data structures, algorithms, and ETL concepts.
- Experience with Azure Machine Learning for managing and deploying machine learning models.
- Hands-on experience with Azure Data Factory for orchestrating data workflows.
- Familiarity with other Azure data services (e.g., Data Lake, Synapse).
Additional Information
All your information will be kept confidential according to EEO guidelines.
