Results-driven Data Engineer with extensive experience at BTG Pactual, specializing in optimizing data pipelines using PySpark and AWS. Proven track record of reducing processing costs by 20% and enhancing team productivity through automation. Skilled in SQL and Airflow, with a strong ability to integrate complex systems effectively.
Python, PySpark, SQL, AWS (S3, EMR, Lambda, SNS, SQS), Airflow, Data Lake, MySQL, MongoDB, PostgreSQL, PowerBI, ETL, Iceberg, Power Center