Python Engineer
Our client is seeking a Contract Python Engineer to join their team and play a key role in developing a cutting-edge machine learning annotation platform. This role focuses heavily on building annotation applications that deploy data pipelines and workflows to process and deliver annotation data. You will collaborate closely with data scientists to understand annotation requirements and develop solutions that meet those needs. This role will involve the creation of Python libraries and working on Databricks APIs for Machine Learning initiatives. If this aligns with your background and experience, we would be highly interested in speaking with you!
Top 3 Required Technical Skills:
- Python Development: Expertise in developing robust, scalable solutions using Python, with a focus on data processing, automation, and pipeline creation.
- DataFrame Frameworks: Proficiency in Pandas or equivalent frameworks such as PyArrow or Polars, with hands-on experience manipulating large datasets efficiently.
- Spark Experience: Solid understanding of distributed data processing using Spark (e.g., PySpark), including writing and optimizing transformations, working with large-scale datasets, and building ETL workflows.
- SQL: ability to write complex SQL transformations and develop SQL scripts for data validations
Nice to Have Skills:
- ETL pipeline
- Databricks Platform
- OpenCV / image processing OR Annotation for machine learning
- SQL, AWS