Highly skilled Data Engineer with 5+ years experience
Contact me:
My Resume
Click to expand and get more details
Work experience
Title
- Developed Marketing Data Lake
- Migrated data pipelines from in-house built solution to data-composer(Airflow)
- Identified and improved expensive data processes to reduce infrastructure and cloud costs in GCP
- Introduced and implemented policies to improve company's Data Governance
- Tech stack: GCP, data-composer, Luigi, Python, BigQuery, Docker, Terraform, Grafana, Kafka, Fivetran, Jenkins
- Designed and implemented data architecture for ML-powered internal Document Search Engine tool
- Leveraged ML methods to process documents (anonymization, OCR, deduplication)
- Tech stack: Airflow, Python, Postgres, Azure Data Lake, SQL, FastAPI, Docker, Kubernetes, RabbitMQ, ElasticSearch
- Built data pipelines for internal and external data sources and developed in-house
DWH system
- Developed company's Finance data models (Kimball methodology)
- Tech stack: Airflow, Python, Snowflake, DBT, Gitlab, Stitch/Fivetran, Kubernetess
- Developed ETL pipelines for internal and external data sources and developed in-house
DWH system
- Developed Airflow plugin to automate Sales' team day-to-day data operations
- Improved the company's dispatching process by automating worker to task assignment
- Tech stack: Airflow, Python, Postgres, Gitlab CI/CD
- Built & maintained data transformation pipelines for injecting client data into CiviCRM
- Tech stack: Python, SQL, Airflow, Pentaho, MySQL
- Developed and maintained the company's in-house DWH system, integrated data from internal and 3rd party APIs
- Developed daily billing process to report all transactions into external Order Management System
- Developed ML-powered internal tools: Sales Lead Generator and Vendor Backend Issue Discovery
- Tech stack: Python, SQL, Postgres, Redshift, Jenkins
- Developed a multi-client datawarehouse system for the roll-out of an international e-Commerce company
portfolio
- Tech stack: Python, SQL, Postgres, BigQuery, Jenkins
- Worked with stakeholders and PMs to gathering and analyze business requirements, prepare solution design and technical
documentation
- Documented application flows and process designs
- Developed internal reporting tools (KRI Reporting tool) and Excel/Access/VBA automations
Certification
Education