American Express

Engineer I 

Engineer II (Data & AI)

Accenture

• Worked in a healthcare based multi vendor Big Data project which uses Agile methodology SDLC.
• Worked on Azure Data Factory and SQL.

Data Engineering Analyst

• Worked on Azure Data Factory, Azure Synapse and SQL in a healthcare based multi vendor Big Data project.
• Created complex Hive and SQL queries to perform sanity checks of data.
• Developed 'Test Script Generator' using Python which can generate multiple Test Scripts containing Hive and SQL queries within fraction of a minute.
• Worked on PySpark, HDFS and Hive in a Big Data project.
• Performed transformation of health data from Hive tables using PySpark for a costing project and loaded transformed data back to Hive tables.
• Developed Python script for the cleaning of JSON file using RegEx concepts.
• Performed Ingestion of batch data to HDFS and then performed data analysis using PySpark (RDDs and DataFrames) for insurance claims data.

Data Engineering Associate

APPTOLOGY INDIA

• Worked on developing an android app "Event Central" which helps the organizers to organize and manage events and users to book tickets for the event. 
• Designed multiple UI screens, developed code for saving data to Shared Preferences, and integrated Facebook login SDK in the app.
• Technology used : Android
• Software used : Android Studio

Intern (Android)

Currently working as Data and AI Engineer on PySpark, Spark SQL, Python, Hive, Machine Learning, Scikit-learn, Generative AI and Linux. I also contribute to Open Source repositories specifically related to AI like Keras etc.


-----------------Skills------------------------
Programming Languages: Python, Java
Query Languages: SQL, Spark SQL, Hive QL
Big Data: PySpark, Hive, Jethro
ETL: Azure Data Factory
Cloud: Google Cloud Platform, Microsoft Azure
Machine Learning: Scikit Learn
Deep Learning: Tensorflow, Keras, fast.ai
Generative AI: Langchain, Llama-index
Data Analysis: Pandas
Data Visualization: Matplotlib, Seaborn
Software Development: Android App Development, Linux, Git
Project Management Tools: Jira, Rally
SDLC: Agile

-----------------Links-----------------------------
GitHub: https://github.com/pksX01
Medium: https://pksx01.medium.com
Blog: https://pksx01.github.io/AI_Blogs
Topmate: topmate.io/pavan_kumar_singh

Taplio

Pavan Kumar Singh's Linkedin Analytics

Pavan Kumar Singh

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Pavan Kumar Singh's Linkedin Analytics

Pavan Kumar Singh

Want to drive more opportunities from LinkedIn?

Pavan Kumar Singh's Linkedin Analytics