Etl Developer Resume
Columbus, OhiO
SUMMARY
- Around 16 years of total experience across full life - cycle of application software development including requirements, analysis, design, development, integration, maintenance of Datawarehouse and experience in requirement analysis
- Design, Build and administer Secured Enterprise distributed computing clusters (HDP/HDF/CDH), BI/Big Data Application design data ingestion flows for both real time and batch
- Test Driven Development/Quality Assurance/Control and Implementation of Big Data Applications/data warehouses with strong understanding of Dimensional Modeling, Star & Snowflake Schemas, data staging, decision support system (DSS).Technical Skills:
TECHNICAL SKILLS
Hadoop Eco System: HDP 2.x, CDH 5.x, HDFS, MapReduce, Spark, Hive, HBase, Sqoop, Pig and Oozie
Operating System(s): Sun Solaris, Suse Linux Windows XP, Windows Server, IBM AIX, CentOS
Databases / RDBMS: Oracle 8i/9i, Teradata 13.10
Languages: Sql, Pl/Sql, Shell Scripting
Internet Technology Skills: Oracle 9 Internet Application Server
Schedulers: Control-M, Autosys, CA-7
ETL: Ab initio
PROFESSIONAL EXPERIENCE
ETL Developer
Confidential, Columbus, Ohio
Responsibilities:
- Requirement Gathering, Effort Estimation and Analysis impact.
- Developed and Implemented extraction, transformation and loading the data using Ab Initio.
- Work with the team of analysts, developers, testers and drive delivery of ETL Solutions.
- Manage all aspects of a BI technical roadmap, including platform requirements
- Design of KPIs
- Worked with reports developer to understand their needs
- Responsible for data definitions
- Source system identification
HAdoop Administrator
Confidential
Responsibilities:
- Responsible for building Enterprise Hadoop Cluster HDP 2.X and day to day administration tasks
- Co-ordinating with networking, infrastructure and development teams to ensure high availability
- Cluster maintenance including adding new nodes to existing cluster and realigned server components between master nodes based on requirements
- Add and remove nodes using Ambari
- Expanded cluster capacity from 18 nodes to 24 nodes by bringing new node into cluster (Add node operations) removed problem nodes for diagnostic and remedying
- Providing inputs to architecture team for capacity planning
- Working with Hortonworks support team for high severity tickets
- Collaborating with Enterprise application team to Install operating system and Hadoop updates, patches, version upgrades when required.
- Driving initiative to automate the recurring manual activities for monitoring and operations using Unix Scripting.
- Enabling High Availability for multiple server components.
- Implemented Kerberos and AD security authentications.
- Setup HDFS and Hive authorization using Ranger
- Automated code promotions/deployments using Ansible
Analyst / Developer
Confidential
Responsibilities:
- Production support for DCDB, Migration support for Migration of Holliswealth to Industrial Alliance
- Manage all aspects of a BI technical roadmap, including platform requirements and support for end-user BI tools.
- Lead architect in development, design, execution, and implementation of complex dashboards and BI self-service solutions.
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts.
- Work in conjunction on multiple use cases involving Hive/Hbase/HDFS/Kafka
- Partner with internal teams and vendor partners to provide technical leadership in order to develop and support effective BI solutions, performance tuning and reports
ETL LEad
Confidential
Responsibilities:
- Created Ab initio Graphs, Ab initio code review tuned them for better performance.
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts.
- Created Naming conventions document for all the components
- Acted as team lead and key point of contact for the business for any production issues
- Managing any production issues raised and follow up with business and other vendors through to final resolution.
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts.
- Created Naming conventions document for all the components
- Created the UTC documents
- Worked with Ab Initio Multi File Systems (MFS) and complex ETL transformation
- Database Design, tuning, configuration Management.
- Created and coded functional and business constraints, packages and triggers
ETL developer/Semantic modeler
Confidential
Responsibilities:
- Information Strategy Road Map
- Data Acquisition & Environmental Review
- Deliver a Roadmap
- Co-ordination of all the teams
- Involved in Semantic layer design
- Performance tuning BI applications
- Worked with reports developer to understand their needs of performance for report generation
- Support for Production Implementation
- Responsible for data definitions
- Source system identification
- Worked with end users to define business requirements and needs, performing data validation
- Wrote Business rules mappings for ETL team for coding
senior abinitio developer
Confidential, salt lake city
Responsibilities:
- Analyze and understand complex business Requirements from High-level documents
- Estimate the effort for enhancement and development activities based on the complexity.
- Create low-level design documents based on the HLD understanding and develop Ab Initio
- Graphs based on the requirements.
- Create test plans and capture test results and review the results with business.
- Periodically conduct code reviews to ensure that it meets the standards and best practices.
- Highlight issues, concerns etc. at the earliest and do defect prevention/resolution activities.
- Co-ordinate with the offshore development team and provide guidance to junior members of the team.
- Involved with Performance tuning to decrease the run times.
- Provided L1-L3 support to all the applications and handled the change management and incident ticket resolution.
Senior abinitio developer
Confidential, Memphis
Responsibilities:
- Analyze and understand complex business Requirements from High-level documents
- Estimate the effort for enhancement and development activities based on the complexity.
- Create low-level design documents based on the HLD understanding and develop Ab Initio
- Developed and Implemented extraction, transformation and loading the data from the legacy systems using Ab Initio
- Created detail data flows with the source to target mappings and convert data requirements into low-level design templates.
- Responsible for data cleansing from source systems using Ab Initio Components such as join,dedup sorted, Denormalize, Normalize, Reformat, Filter by the expression, Rollup
- Worked with Partition Components like Partition by key, Partition by Expression, Partition by Round Robin to partition the data from a serial file.
- Developed Generic graphs for data cleansing, data validation, and data transformation.
- Involved in System and Integration testing of the project.
- Tuning of Ab Initio graphs for better performance.
- Used phases/checkpoints to avoid deadlocks to improve efficiency.
senior abinitio developer
Confidential
Responsibilities:
- Worked closely with the Business Analysts and application leads for requirement study, analysis and design of the application.
- Created low-level design documents for the various application process
- Developed Abinitio graphs that transfer data from flat files to Teradata data warehouse
- Extensively worked on most commonly used components to complex components like scan, Roll up, Assign keys, Partition, Departition, Sort, Join, Reformat Components etc.
- Used Ab Initio Multifile systems for improving heavy data loads
- Migration of Abinitio graphs according to the new specifications. Responsible for ad-hoc code changes for migrations
- Involved in end to end data validation by interacting with Business (UAT)
- Responsible as a delivery lead for an offshore team
abinitio developer
Confidential
Responsibilities:
- Created Ab initio Graphs, Ab initio code review tuned them for better performance.
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts. • Created Naming conventions document for all the components
- Created the UTC documents
- Worked with Ab Initio Multi File Systems (MFS) and complex ETL transformation
- Created Ab initio Graphs, Ab initio code review tuned them for better performance.
- Worked on UNIX, Shell scripting in development and support of various existing shell scripts. • Created Naming conventions document for all the components
- Created the UTC documents
- Worked with Ab Initio Multi File Systems (MFS) and complex ETL transformation
