Profile picture of Igor Beduschi
Hello, I'm Igor Beduschi!

Data Engineer. I build production ETL pipelines end to end with Python, SQL, Airflow, and Spark, turning messy, high-volume data into reliable systems people can trust.

From ingestion (including web scraping) and orchestration to transformation and delivery on Delta Lake. All with testing, observability, and clean, maintainable code from the start.

Git
Next.js
JavaScript
AWS
Linux
Docker
Tailwind
SQL
Postgresql
Python
Pandas
Pytorch
Fastapi
Airflow
Scikitlearn
PowerBI
Excel

About Me

_

I'm a Data Engineer who likes turning messy, high-volume data into reliable systems people can trust. I build production ETL pipelines end to end: ingestion (including web scraping), orchestration with Airflow, transformation in Python, and delivery on Delta Lake. I also care about the parts that keep data dependable: testing, observability, and clean, maintainable code. I came from full-stack development before moving into data, so I'm as comfortable shipping a Django dashboard as I am tuning a DAG. To me, good technology is accessible and transparent: it solves real problems for the people using it, not just on paper.

Experience

  1. Logo of One Investimentos | Data Analytics Engineer

    One Investimentos | Data Analytics EngineerLatest

    • Design and maintain ~30 daily production ETL pipelines (Airflow DAGs) in Python, delivering reliable, analytics-ready data on Delta Lake.
    • Helped define the data team's standards for observability (Grafana, Loki, VictoriaMetrics) and Polars adoption across a 4-person team.
    • Cut a pipeline's peak memory usage by ~97% (16 GB to under 500 MB) via memory-efficient processing (Polars/DuckDB), caching, and resource limits.
    • Refactored legacy code to Polars and Django, and built internal LLM tooling (custom Claude skills) to standardize workflows.
    • Implemented data quality tests (schema and business-rule validation) and unit tests for core ETL components, preventing regressions across updates.
  2. Logo of Oncoclínicas | Data Analyst

    Oncoclínicas | Data Analyst

    • Developed ETL processes to integrate and clean datasets, improving the agility of internal operations.
    • Used Python and its data processing libraries to automate workflows and turn raw data into actionable insights.
    • Provided analytical support and dashboard creation with Power BI and Excel, assisting stakeholders across different teams.
    • Helped promote a data-driven culture by engaging non-technical users, fostering data literacy, and encouraging informed decision-making across the organization.
  3. Logo of Banco Mercantil | Data Analyst

    Banco Mercantil | Data Analyst

    • Built ETL processes for data integration and cleaning in Python, improving data reliability and departmental efficiency.
    • Automated recurring internal workflows, reducing manual effort and speeding up reporting.
    • Developed interactive dashboards (Python, Power BI) to make analysis accessible to non-technical teams.
  4. Logo of Inter | Data Translator

    Inter | Data Translator

    • Supported data governance across teams, ensuring compliance, consistency, and high-quality data for data-driven projects.
    • Used IBM Data Catalog to organize, classify, and maintain metadata, improving data discoverability and governance.
    • Drafted technical documentation and functional specs for new data initiatives, keeping technical and business requirements aligned.
    • Contributed to data pipelines and lake/warehouse structures on AWS (S3, EC2, Athena) with Python, SQL, and Spark, and built dashboards in Tableau.
  5. Logo of Syngenta Digital | Developer

    Syngenta Digital | Developer

    • Collaborated in agile teams to develop scalable web solutions using ReactJS, TypeScript, and JavaScript.
    • Implemented and maintained features focused on performance and usability in cloud environments (AWS).
    • Wrote unit tests with Jest to ensure code reliability and maintainability.
    • Worked with Git for version control and Trello for project tracking, contributing to effective collaboration and continuous delivery.
  6. Logo of 2x3 | Developer

    2x3 | Developer

    • Worked on full-stack development with PHP, Ruby on Rails, JavaScript, and MySQL across various client projects.
    • Managed client support tickets, delivering technical solutions and keeping strong communication with stakeholders.
    • Used Git for code versioning, Trello for project management, and Docker for deployment.
    • Handled web server maintenance in environments using AWS and Apache.
  7. Logo of Prodemge | Technical Support

    Prodemge | Technical Support

    • Provided technical support and infrastructure maintenance, including configuration and testing of client systems.
    • Participated in manual testing of internal tools and supported applications involving digital certification.
    • Helped prepare test plans and system performance reports, contributing to the reliability and efficiency of critical services.

$ echo "let's talk data, get in touch"

Made with 🤍 by Igor Beduschi