Kavak.com

As Principal Engineer at Data Team,Kavak, I led the development of a scalable data platform on AWS to support the company’s rapid growth. I worked with tools like Glue, Redshift, and Lambda to ensure the platform could handle increasing data and users efficiently.

I also integrated Generative AI into our processes, which helped speed up code reviews and created automated alert systems to catch potential issues early. I focused on keeping our data quality high through strict checks and made sure we followed the best security practices to protect our data.

One of my biggest achievements was implementing cost-saving strategies that reduced cloud expenses by over $1M annually. I also designed data products that were easy for teams to use, making it simpler for them to access the data they needed.

In addition, I helped grow our data engineering team to more than 30 members, ensuring we had the talent to keep up with the company’s growing needs.

Principal Engineer

Data Platform architect

Founding data engineer

GNP Seguros

I led the creation of new data products using all the tools available on Google Cloud Platform. My goal was to design and build scalable solutions that met our business needs.

Challenges and Solutions:

One of the biggest tasks was moving important data systems from old, outdated setups to modern, cloud-based solutions. I managed this transition smoothly, updating our systems to be more scalable and efficient.

Another challenge was dealing with large amounts of data. I set up efficient processes to handle these big data sets, making sure everything ran smoothly and reliably.

I also focused on making sure we followed all industry rules and standards. This was crucial for maintaining the trust and security of our data operations.

To keep our data accurate and reliable, I used Amazon Deequ to build strong data quality checks, ensuring all our data met high standards.

Tools and Technologies:

I used various Google Cloud services, including Dataproc, BigQuery, Dataflow, and Cloud Composer (Airflow). For processing large amounts of data, I used Apache Spark, and I wrote code in Scala to improve the efficiency of our data products.

Senior Data Engineer

Wizeline Teams

Role and Responsibilities:

Data Engineering Consultant on Hortonworks Data Platform:

 Developed  Data ingestin pipelines from external sources  using Hortonworks Data Platform, focusing on scalability and efficiency.
Data Ingestion and Processing:

Expertly managed data ingestion processes, ensuring reliable and timely flow of data into the system.
Implemented advanced data processing techniques to optimize data usability and accessibility.
Technologies and Tools Used:

Utilized Hive for data warehousing solutions, enabling efficient data querying and analysis.
Employed Oozie for workflow scheduling and management, ensuring streamlined data operations.
Leveraged Apache Spark for large-scale data processing, enhancing performance and scalability.
Developed and maintained solutions using Scala, integrating modern programming practices for robust data engineering.

Data Engineer

Tata Consultancy Services

Role Overview:

In my role as a Hadoop Developer at Tata Consultancy Services, I was a key member of the Data Intelligence team, primarily focusing on leveraging Hadoop ecosystems to enhance data processing and analysis capabilities for a financial client. My responsibilities included developing and optimizing Hadoop-based applications, ensuring efficient data storage, and processing large volumes of data to derive actionable insights. This position allowed me to deepen my expertise in big data technologies and contribute significantly to the data-driven objectives of the company.

Hadoop Developer

Senior Software Developer

Software Application Developer

Principal Software Engineer with 13+ years of experience in designing scalable data solutions.

- Expertise in building high-performance data platforms, particularly on AWS.
- Solved complex challenges in data integration, architecture, quality, and security.
- Achieved $1M+ in annual savings through strategic, cost-effective solutions.
- Proficient in tools across AWS, GCP, Apache Spark, Apache Flink, and Datahub.
- Scaled a data engineering team to 30+ professionals as Principal Engineer.
- Developed user-facing data products and GEN AI applications for internal and external use.
- Focused on optimizing data processes while ensuring cost efficiency and compliance.
- Strong track record of aligning data architecture with business goals to drive a data-driven culture.

Taplio

Milan Sahu's Linkedin Analytics

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Milan Sahu's Linkedin Analytics

Want to drive more opportunities from LinkedIn?

Milan Sahu's Linkedin Analytics