Software Engineer – Python, ML & DS
aioneers GmbH · Pune, India
Aug 2023 – Dec 2024
- Contributed to the development of the company's flagship products by building robust data pipelines to connect with user data sources.
- Implemented a Data-Foundation service to connect with user data sources using Extract, Transform, and Load (ETL) techniques, and applied advanced data cleaning to ensure data integrity and quality.
- Developed a rules-engine service to process and apply rules to data from the Data-Foundation service, transforming it into impactful insights represented as impact dots.
- Created an Insights server for visualizing user data from the Data-Foundation service and presenting it in dashboards in the form of charts.
- Integrated Delta Lake and Azure Databricks to process millions of records, improving processing speed and scalability.
- Implemented a Copilot service across these products, using OpenAI LLM APIs for backend responses.
- Managed production pipelines and provided client support for production issues, ensuring stability and reliability for client-specific data operations.