Responsive expert experienced in monitoring database performance, troubleshooting issues and optimizing database environment as well as developing modern data pipelines.
Possesses strong analytical skills, excellent problem-solving abilities, and deep understanding of database technologies and systems. Equally confident working independently and collaboratively as needed and utilizing excellent communication skills.
Overview
1
1
year of professional experience
Work History
Data Engineer
Just a Little Data / Unlock Knowledge
São Paulo, Sao Paulo, Brazil
09.2022 - Current
Responsible for data pipelines development and maintenance, data modeling, security, governance and also the infrastructure regarding all data lifecycle such as docker containers, virtual machines and orchestration services
Modern Data Stack Development using AWS and GCP and open source technologies such as Airflow, Airbyte, Docker, SQL and Python
Data Lake House Optimization and maintenance using BigQuery and Redshift
Decrease data ingestion time utilizing multithreading techniques.
Enhanced data quality by performing thorough cleaning, validation, and transformation tasks.
Collaborated on ETL (Extract, Transform, Load) tasks, maintaining data integrity and verifying pipeline stability.
Managed cloud-based infrastructure to ensure optimal performance, security, and cost-efficiency of the company''s data platform.
Migrated legacy systems to modern big-data technologies, improving performance and scalability while minimizing business disruption.
Designed and developed analytical data structures.
Explained data results and discussed how best to use data to support project objectives.