Midnite

Lead Data Engineer

Bidnamic

Data Engineer working with Python, Airflow, Postgres and AWS to develop a market leading Google Shopping bid optimisation solution.

• Redesigned the entire source data ingestion process and migrated legacy code to new Google Ads API.
• Researched, recommended and implemented best practice of continuous data quality monitoring in pipelines.
• Designed and implemented a standardised library of reusable and fully unit tested data cleaning utilities.
• Designed and implemented company parquet lake to provide analytics capabilities to the wider business, utilising
AWS Athena as the query engine.
• Designed internal tooling and components to standardise data lake and parquet lake file paths to provide
integrity to the lake structures and underlying data.
• Independently identified performance bottlenecks and delays, recommended and implemented best practice
solutions, including SQL query optimisation and implementation of indexes and other best practices.
• Identified Airflow anti-patterns causing performance bottlenecks and system reliability issues, recommended and
implemented best practice solutions.
• Migrated legacy exchange rates codebase to a simple, but powerful internally managed system.
• Provided constructive feedback on PR reviews of colleagues and peers.
• Ensured all work was thoroughly unit tested by using a TDD approach.

Data Engineer

graze.com

Lead Data Engineer responsible for the design, implementation and maintenance of the Unilever UK Insights Hub, an Azure-based big data platform, enabling a shift to a data-driven decision-making process in the UK.

• Researched, designed and implemented best-practices for key technologies in the architecture including Azure Data Lake Storage, Databricks Delta Lake, Spark, Data Factory and Azure SQL Data Warehouse
• Identified limitations of Azure services and designed appropriate solutions to achieve business objectives.
• Designed, implemented and maintained over 24 data pipelines, delivering over 100TB of data to data analysts,
data scientists and business-oriented end users.
• Worked with the Data Science team to provide clean and timely data, enabling the timely delivery of business
objectives.
• Assisted the CTO in key decisions of the overall architecture of the UK Insights Hub.
• Trained, mentored and assisted with junior members of the data engineering and wider data team.

Infectious Media

Quickly rising to a respected member of the data engineering team, taking lead on the design and migration of the legacy in-house ETL solution to Airflow, with a focus on researching and implementing Python, Airflow and general coding best practices and techniques.

• Migrated significant portions of legacy in-house ETL solution to Airflow (GCP Composer).
• Designed and developed integrations to key data sources as reusable Airflow plugins.
• Identified opportunities for and developed custom Airflow operators for use in the ETL pipeline, improving code
quality and reducing code duplication.
• Recommended and implemented a company code style guide and development best practices of docstrings, unit
testing, general code commenting and commit/pull request messages, resulting in significantly more
maintainable and understandable code.
• Recommended and implemented a robust testing framework including unit testing of Airflow operators, as well
as the implementation of a staging environment to facilitate streamlined end-to-end integration testing.
• Identified and rectified several long-standing bugs, improving data quality and performance of the ETL pipelines
• Mentored junior members of the team and participated in the PR review process, providing valuable technical
and business expertise and knowledge to the wider team.
• Participated in the interview and selection process of new data engineering candidates for the team.

University of Southern Queensland

Energised for a new career pathway, returning to Australia to complete a PgDip Data Science qualification, focusing my entrepreneurial, analytical and business skills into a challenging programme. Studying full time, working hard to develop programming competency as well as advanced knowledge of programming, data analysis, data science and big data.

• Gained strong programming capabilities in Python, R and C++; building on existing skills in SQL.
• Studying winning methodologies for Data Analysis, Statistical Analysis, Data Mining and Machine Learning. 
• Hands-on developing Advanced Relational Databases and handling Big-Data. 
• Programmed Visualisations, Dashboards and Reports within data science learning streams. 
• Developed a deep understanding of the role of Business Intelligence and Data Science in business success.

Post-Graduate Diploma of Data Science Student

MyWorkpapers

Seizing an opportunity to move to the UK and join a start-up business as the 3rd member of the team, naturally exposed to all aspects of the business, primarily from a Product Development perspective. Working in a start-up environment dealing with daily challenges, uncertainties and change, including the growth of the company from 3 to 20+ employees in 4 years. The role that sparked an interest in programming and technology in business. 

• A key influencer within the senior management team and driver of the start-up and growth phase. 
• Initiated and nurtured a billion-Euro strategic relationship with a European distribution partner.
• Product manager to the MyWorkpapers product lifecycle; project managed upgrades and new modules. 
• Owned the post-release product vision including pricing strategy, user training and technical support. 
• Business analyst to the product lifecycle, responsible for user stories, requirements and test lifecycles. 
• An effective analyst responsible for the capture, analysis and reporting of customer metrics and KPIs.

Product Manager

Crowe Horwath International

Achieving a rapid progression from Graduate Accountant to Manager of the audit team, responsible for a portfolio of clients and their audit requirements. Hands-on developing policies, audit frameworks and methodologies to ensure that regulatory standards were sustained. 

• Instrumental in growing the audit division annual revenue by +30%. 
• Achieved 85% of all engagement under budget and on-time to exceed client expectations. 
• Gained exposure to accounting, audit and commercial operations and solved tough process problems. 
• Utilised MI data to identify weaknesses in the business and plan for change and improvement.

Audit Manager

Audit Senior

A Lead Data Engineer with a robust history in start-up businesses. Highly proficient in Python and SQL, with significant experience in both migrating legacy codebases, as well as implementing greenfield solutions from the ground up using modern best practices and solutions. A proven self-starter with the willingness and ability to independently research and implement best practice solutions. Always willing to learn new skills and take on unknown challenges. Excels in ambitious, entrepreneurial and challenging work environments with a high degree of autonomy.

Taplio

Todd de Quincey's Linkedin Analytics

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Todd de Quincey's Linkedin Analytics

Want to drive more opportunities from LinkedIn?

Todd de Quincey's Linkedin Analytics