Summary
Overview
Work History
Education
Skills
Websites
Languages
Technical And Personal Skills
Languages
Timeline
Generic

Edvaldo Azevedo

Cabedelo- Paraiba

Summary

Results-driven Data Engineer with extensive experience at BTG Pactual, specializing in optimizing data pipelines using PySpark and AWS. Proven track record of reducing processing costs by 20% and enhancing team productivity through automation. Skilled in SQL and Airflow, with a strong ability to integrate complex systems effectively.

Overview

6
6
years of professional experience

Work History

Data Engineer/Analytics Engineer

BTG Pactual
São Paulo
01.2022 - Current
  • Developed credit data pipelines for the CRC and Financing teams, creating, monitoring, and optimizing the processing of large volumes of data using PySpark, AWS, S3, EMR, Airflow, and Lake Formation.
  • Built data pipelines for the Core Lake project using PySpark, AWS S3, EMR, and Iceberg, optimizing large-scale data processing.
  • Reduced processing costs by 20% through the implementation of best practices in Data Engineering.
  • Integrated systems using Airflow, SNS, SQS, and Lambda functions.

IT Analyst

ACT Consultoria
São Paulo
03.2019 - 09.2020
  • Automated insight processes using batch data with Python and AWS, contributing to CRM team productivity.
  • Integrated systems using Airflow, SNS, SQS, and Lambda functions.

Business Intelligence Analyst

Indra Company
João Pessoa
03.2019 - 09.2020
  • Extracted and transformed data to create optimized staging layers.
  • Implemented and maintained dashboards in BI environments.
  • Tools: SQL, Python, ETL, AWS, MongoDB.

Education

Postgraduate - Data Science

UNIFACISA
Brazil
01.2020

Bachelor’s Degree - Information Systems

UNIFACISA
Brazil
01.2017

Skills

  • Python
  • PySpark
  • SQL
  • AWS
  • Airflow
  • Data Lake
  • MySQL
  • MongoDB
  • PostgreSQL
  • PowerBI
  • ETL
  • Iceberg
  • Power Center

Languages

  • English, Intermediate, Intermediate, Advanced
  • Spanish, Basic

Technical And Personal Skills

Python, PySpark, SQL, AWS (S3, EMR, Lambda, SNS, SQS), Airflow, Data Lake, MySQL, MongoDB, PostgreSQL, PowerBI, ETL, Iceberg, Power Center

Languages

Portuguese
First Language
English
Intermediate (B1)
B1

Timeline

Data Engineer/Analytics Engineer

BTG Pactual
01.2022 - Current

IT Analyst

ACT Consultoria
03.2019 - 09.2020

Business Intelligence Analyst

Indra Company
03.2019 - 09.2020

Postgraduate - Data Science

UNIFACISA

Bachelor’s Degree - Information Systems

UNIFACISA
Edvaldo Azevedo