Senior Data Engineer
Hackajob
hackajob on-demand connects talented contractors like you with organisations that need specific skills for their projects. We use our platform to connect you with exciting contract opportunities and discuss projects on behalf of the companies we partner with.
About the Role
We are seeking a Senior Data Engineer to support a contract engagement with a leading financial services organisation in Orlando, FL. You'll be designing, building, and maintaining robust ETL pipelines using IBM InfoSphere DataStage, transforming inbound file feeds into reliable, auditable SQL Server table loads that production teams depend on every day.
This is a hands-on engineering role in a structured, enterprise environment — ideal for someone who takes pride in building pipelines that are clean, performant, and built to last.
What You'll Be Doing
- Design, develop, and maintain IBM DataStage ETL jobs that ingest file feeds (CSV, fixed-width, delimited) and load curated destination tables in SQL Server
- Build end-to-end ETL flows covering staging, transformation, validation, and publishing to downstream schemas
- Perform source-to-target mapping and implement transformation logic based on business and technical requirements
- Write, optimise, and tune SQL Server queries, stored procedures, and T-SQL scripts used in ETL workflows
- Implement restartable, supportable jobs with parameterisation, robust logging, reject handling, auditing columns, and reconciliation checks
- Apply data quality controls (format, referential, null/duplicate, and threshold checks) with clear exception outputs
- Monitor and troubleshoot ETL runs using DataStage Director/Operations Console; perform root-cause analysis and resolve defects
- Tune job and SQL performance through partitioning strategy, sorting, buffering, indexing, and pushdown logic
- Maintain clear runbooks, operational procedures, and documentation; participate in code reviews and release activities
- Collaborate with business analysts, data modellers, QA, and production support to deliver stable, reliable pipelines
What We're Looking For
Required:
- Hands-on IBM DataStage ETL development experience, including data mapping and transformation implementation
- Strong SQL Server experience with advanced T-SQL (joins, window functions, CTEs, temp tables, indexing, query plans)
- Solid understanding of file-based ingestion and parsing (CSV, fixed-width, headers/trailers, control totals, encoding, delimiters)
- Experience designing ETL jobs with strong operational characteristics: parameter-driven design, logging, error handling, and restart/re-run strategy
- Ability to troubleshoot data issues end-to-end and communicate findings clearly
Preferred:
- DataStage Parallel Jobs tuning (partitioning methods, collect/sort trade-offs, skew handling)
- UNIX/Linux basics and shell scripting for orchestration and file handling
- Experience with job schedulers (Control-M, Autosys) and CI/CD practices
- Familiarity with warehousing patterns (incremental loads, SCDs, surrogate keys, effective dating)
- Version control experience (Git) and structured dev/test/prod promotion processes
- Exposure to data governance practices and secure handling of sensitive data
The Details
- 📍 Location: Orlando, FL — Hybrid, 3 days onsite per week
- 📄 Type: Contract with strong potential for extension