Pura

Senior Data Engineer

Dutch Engineer

I can write blog posts, LinkedIn posts, demos, or share advice about your data or machine learning infrastructure.

Founder

EcZachly Inc

Instructor and Lead Teacher Assistant

Zwift

Build long-term roadmaps for machine learning platform and code best practices for the data science team
Orchestrated the implementation of DBT to build data lineage and shorten debugging time by 30%
Deployed XGBoost models to identify customers who will might or not subscribe in free trials. 
Lead a team to provide the best short-term and long-term solutions to reduce service downtime by 50%
Own e-commerce datasets to lower handle data quality, data contracts, and resolve pipelines downtime
Tools: AWS, Kafka, Python, Docker, Kubernetes, Scala, Spark, SQL, Airflow, Jenkins,  DBT

Senior Data and ML Platform Engineer

Clinical Trial Media

Documented technical specifications of workflows to be presented to stakeholders and executive team
Automated and optimized existing workflows using Prefect and dbt to adhere to best practices
Tools: DBT, Prefect, Azure, Azure Data Factory, Python, SQL, Tableau Server, Docker

Qumulo

Lead migration of on-premise pipelines to cloud capable of handling 210+ GB per day
Produce key metrics to counsel sales and engineering and drive product feature decisions
Integrate linters, tests, and CICD to improve Data Science code quality 
Tools: AWS, Redshift, S3, Postgresql, Pyspark, Fargate, Python, Gitlab CICD, SQL, MongoDB, Tableau

Data Scientist

Blueprint Technologies

Created 30,000 customers’ metric sheets that calculated employees behavior for 1.5 months before and 1.5 months after covid and presented to the c-executive suite of the F500 company 
Developed daily pipelines with >500 TB that build employee behavior metric sheets on request
Productionalize Decision Tree and Logistic Regression to prioritize likely buyers
Optimize SQL and PowerShell scripts to reduce running script from 3 days to 15 minutes.

Tools: Azure Databricks, Python, Plotly, PowerShell, C#, COSMOS, SQL

Data Engineer

Redapt Inc

Migrating Hadoop cluster on VMs to Google Cloud Platform's Dataproc cluster
Importing, cleaning, and visualizing data in Power BI dashboards
Building a storage infrastructure system to identify frequent patterns and errors 
Incorporating Machine Learning algorithms to recommend new items for over a million items and for several thousands of customers. 
Tools: Hadoop, Kafka, Airflow, Spark, Power BI, Azure Databricks, Azure ML Studio, Azure Blob Storage

Apex Learning

Build a python script to obtain Zendesk's data via its RESTful API for marketing reports
Redesigned monthly and yearly reports by incorporating Tableau Software to evaluate tutors’ performance 
Implement Salesforce.com to create an easily accessible school’s credit acceptance database for marketing campaigns 
Support middle and high school students’ through the Apex Learning Virtual School curriculum

Online Tutoring and Data Analysis

Projects

ILest: Ionic Liquid estimation Tool
Team project, Implemented LASSO, SVR, and MLP-Regressor on 10,000 data points to estimate the desired properties of ionic liquid binary mixtures for electric battery applications
Tools: scikit-learn, Pandas, RDKit, Matplotlib

Data-Driven Design of Perovskite
Team Project, Carried out LASSO, and supervised neural networks on a reduced data set to identify the optimal combination of elements in the hybrid organic perovskites (crystals)
Tools: scikit-learn, Pandas, RDKit, Matplotlib

Stack Overflow: Suggest a Tag for My Post Please 
Queried 150k posts and users details to determine tags needed based upon a posts' body or score.
Tools: PySpark, Neo4j, Plotly, Python, Cypher, SQL

How Much Will Your Videogame Sell For? 
Web scraping video game tweets and statistics from VGChartz to predict their unit sales using machine learning
Tools: BeautifulSoup, Matploblib, multiprocessing, requests, plotly

Twitter Scraping Tool
Web-scraped old tweets from the twitter page to eliminate the usage of the Twitter Official API and decrease the time needed by 60%. Tools: pyquery, requests, datetime

Senior Data & ML Platform Engineer | dutchengineer.substack.com | Host of Ask A Data Mentor Podcast

Built long-term roadmaps for data platform and machine learning platform
Experience in designing, analyzing, and visualizing large (>500 TB) datasets 
Build and manage multiple ETL infrastructures to identify text patterns and detect network and hardware anomalies
Prepare critical metrics to guide product decisions in people, healthcare, computer games, and chemical analytics
Multilingual (Dutch, English, Spanish)

Keywords: Airflow, AWS (Cloudwatch,  ECS, EKS, Fargate, Glue, Redshift, Kinesis, Databricks, Postgresql, S3), Azure (Azure Functions, Azure ML Studio, Databricks, PowerBI, SQL Server), BentoML, C++, Datadog, Docker, ElasticSearch, Flink, Kafka, Keras, Kubernetes, Hive, High Performance Computing, Github Actions, Gitlab CICD,  Pagerduty, PowerBI,  Prefect, Python (DBT, Numpy, Pydantic, Sklearn,Scipy), Pyspark, Neural Network, Natural Language Processing, MLFlow, MongoDB, Recommendations, Sagemaker, Scala, SparkML, SQL, Tableau, Terraform

Sarah Floris, MS

Pattern®

Pattern is the biggest seller on Amazon.com besides Amazon themselves. 

We operate on Amazon, Shopify, Temu, Target.com, and many other e-commerce platforms. 

And we have 7 data science teams that cover 70+ data science use cases to help us succeed on them (advertising, market intelligence, demand forecasting, demand generation, content, operations, consulting).

DS use our internal ML Platform to self serve development and deployment of their own products end to end.

I direct an MLE and a platform team who build/maintain/evangelize the ML Platform used by DS.

Director of ML Platform, Staff Engineer

MLOps Club

Building a micro-degree to bring you from "Coder" → "Software Engineer" → "Cloud/DevOps Engineer" → "MLOps Engineer". Visit mlops-club.org!

Course Creator, Cloud & MLOps

BENlabs

Lead in the end-to-end design, planning, and implementation of company-wide AI initiatives.

Staff MLOps Engineer

The ML Platform team exists to empower data scientists to rapidly develop and own AI services end to end by making the DevOps and software aspects trivial.

I am accountable for 
• the ML Platform team meeting our quarterly and annual OKRs
• having clear ML Platform architecture and ownership/support model
• platform outages
• interviewing; writing job descriptions
• acting as an individual contributor--but as a secondary priority to managing

ML Platform Team Lead

Some projects:

• Championing a company-wide "constructs library". Like https://constructs.dev/, but just for BENlabs. 

This is a great balance of deploying infrastructure to AWS in a consistent, secure way, but still gives individuals and teams freedom to deviate for new architectures.

Sidenote: we set a goal to have all of our engineers and many data scientists become "IaC-literate". It turned out to be doable. Great boost in speed & quality. Very exciting. Exploring LocalStack to make testing of IaC faster and easier. That's been a pitfall of developing IaC.

• Championing a project, boilerplate code tool (with projen, https://github.com/projen/projen). Goal: data scientists and engineers should be able to "launch" new experiments and products in minutes instead of weeks. 

I made these projects as open-source POCs before continuing them closed-source at BEN and digging deeper. POC for creating repos with IaC: https://www.youtube.com/watch?v=7TDrysCv5xg; POC of Python-projen library https://github.com/phitoduck/phito-projen

• Doing a POC of BentoML as opposed to FastAPI, Seldon Core, etc. for model serving. Gave a meetup talk on it at Utah's MLOps.community chapter. Being active in the BentoML community. 

• Technically, I'm a co-organizer of the MLOps Utah meetup, but I need to contribute more to claim credit for that.

• I'm one of the "local experts" on Auth0, NewRelic, DNS, Pulumi, projen, AWS CDK, packaging, and BentoML.

• Supporting an MLFlow POC, mostly led by Jon Jones.

• Pushing hard for support plans: AWS Support, BentoML dedicated Slack channel, NewRelic support. 

• Seeking ways to form relationships with AI teams at "sister tech companies", maybe with a mutual-NDA. 

• Organized a hackathon with some co-workers and friends outside of work. We made a self-hostable, serverless Minecraft Platform-as-a-Service using AWS CDK. ("pip install awscdk-minecraft") https://github.com/mlops-club/awscdk-minecraft

Senior MLOps Engineer

• Write/extend tools to make DS models trivially easy to "deploy" as REST APIs and in batch jobs on AWS. 

• Lead "hand-offs" of AI products from DS to DE.

• Research/implement MLOps practices: experiment tracking, shadow deployments, catching model drift, etc

• Worked with Steve Jackson and Daniel Clark to build an important JSON:API (web service) whose purpose I probably shouldn't say here. We've continued to use the framework we established here for new AI services. Now, heavily researching observability vendors for correlated metrics, logs, and traces (which trigger alerts). 

• Established patterns for testing applications in docker. Currently developing CI framework to run a battery of tests against services *after* they have been deployed to the cloud, and then on a schedule thereafter.

• Working on a modeling project with DS. I enjoy this and the learnings should feed back into the ML platform tools.

• Did/doing heavy research into no-downtime deployments of REST APIs--particularly when the underlying transactional database schema needs to change with the REST API version.

• Write loads of infrastructure as code. Heavily researching pro's/con's of AWS CDK vs CDKtf vs Pulumi. Also, establishing standards for those.

• Wrote a CLI-tool wrapping Sphinx to generate versioned documentation for all DE/DS repos. The docs build and are published in CI. Docs can be viewed in PRs as well :)

• Extended a project template framework: DE/DS engineers can generate boilerplate Python projects, ready with CI, docs, Dockerfiles, packaging configuration, tests, semantic versioning for internal PyPI server, and other nice things. Every team should have this!

• Actively mentor.

• Actively participate in recruiting and interviewing. Went to career fairs at BYU and UVU. Holding an info session at BYU promoting BEN and offering career advice.

• Participate in our internal AI paper club. Presented on the transformer architecture.

MLOps Engineer

Elevated Analytics

We offered Salesforce analytics via SaaS--as well as mentorship and training on best practices for tracking your sales process. This is ideal for groups who have not hired a full-time analyst but want affordable, high-quality visibility into their sales funnel.

Platform Engineer, Cofounder

rootski

Building an AI startup “in the open”, using the project as a mentorship platform for people wanting to get experience in all sorts of engineering and engineering-adjacent roles.

See the explainer video at https://www.rootski.io (looks awful on mobile 🙂)

Learn about the project and how to contribute here: https://github.com/rootski-io/rootski. Hope to see you on Slack!

Mentor/founder

Karat

Conduct technical interviews on behalf of client organizations.  My goal is to make interviews an uplifting experience for the candidates－whatever the outcome.

Interview Engineer

XANT

• Wrote many data pipelines and support tools using Apache Airflow. I also "Docker-ized" Apache Airflow for our team, managed its deployment in Kubernetes, and worked with the AWS support team to resolve mysterious Airflow/Kubernetes issues.

• Researched "Infrastructure as Code", then led an initiative to standardize deployments of all new services using AWS CloudFormation templates; later leveraged that work to spin up all data engineering services in a staging environment (Terraform, CloudFormation, pretty diagrams)

• Led migration and rearchitecting of a REST API for machine learning inferences, which was consumed by our core product. I used my data science background to reduce the HTTP request latency from 2+ minutes to <20 seconds in the worst case (Flask, python, Airflow, DynamoDB)

• Led an initiative to create and standardize unit testing and CI/CD pipelines for all Python projects (Bitbucket/Bamboo, AWS Container Registry)

• Assisted in maintaining massive data ingest pipelines using Kafka and other tools to land data in S3, Snowflake, and curated relational/non-relational databases

• Made lifelong friends and awesome software with brilliant people

Data Engineer Intern

InsideSales.com

Wrote code to develop data infrastructure including SQL and NoSQL databases, Kafka, RabbitMQ, Airflow, and many services within AWS

• Led trainings 2x/week for analytics team on Python, Docker, Linux, and AWS which enabled multiple team members to independently write and deploy scripts to production.

• Developed a customer churn model from Salesforce and customer usage data. Gathered data SQL and a 3rd-party JavaScript-based query language (JQL)

• Deployed Airflow on a VM to run data pipelines daily. Helped another engineer dockerize and deploy an R script with Airflow that sent alerted account managers of accounts they hadn't reached out to in over a week.

• Learned SQL and DOMO. Also learned to make BI dashboards with a lot of handholding from my manager.

Lessons, looking back years later:

(1) After I left, Airflow fell over and the analysts stopped using it. It was unrealistic to expect a team of traditional B.I. analysts to maintain such a software-engineering-oriented tool. 

Positive note: some Airflow pipelines proved valuable, and were reimplemented in simpler tools.

(2) The customer churn model was not useful so it was abandoned. I think the sad reality is most A.I. projects are not worth building, and it's easy to get distracted to complexity.

Analytics Intern

InnovAsia, Inc.

- Worked with strategy team to identify and implement software solutions that eliminate bottlenecks in 2 million parts per month global supply chain
- Developed application for systems administration of U.S. and Chinese accounts (Python, Bash)

Contract Full-stack Developer

Brigham Young University

Started a rewrite of the lab's landing page in AngularJS. Never finished, but was a valuable learning experience.

Research Assistant in IDeA Labs

Helped a few hundred beginner CS students with clean code and OOP fundamentals in C++

Teaching Assistant (Intro. to Programming)

I'm an ML Platform engineer! What is that?

Yes, Platform Engineering is rebranded DevOps. But the rebrand is trying to get back what DevOps was originally meant to be. And I'm trying to do that for MLOps and Data Science!

It's a super challenging problem because:

• SWE's speak a different language: often, the "best practices" for handling data defy the conventional wisdom in "traditional software engineering".

• Simplicity: MLOps--like DevOps--is a practice, not a person. MLOps is best practiced by the people creating inference pipelines. For DevOps, that's SWE's, but for MLOps, it's... statisticians, academics, domain experts. These are generally people with weak SWE skills. The demand for simplicity is high.

• Risk: ML/AI is about making inferences (guesses). By definition, when you're guessing, it's impossible to write tests that guarantee if your thing works before deploying. You *have* to test in prod. (they call it A/B testing).

ML platform engineering is a new field. And it's awesome.

taplio

The Battle

Sarah Floris, MS

🎧 Eric Riddoch

Followers

Posts

Engagements

Likes

Ready to grow your LinkedIn presence?