Lead - Cloud Development Spark, Python Resume
Chicago, IL
SUMMARY
- IT Professional with 11+ years of software experience spanning a variety of industries and responsibilities.
- Utilizing his MBA in Systems and Bachelor of Engineering in Computers along with his diverse functional, technical, and Lead experience, Mr. Jeevan has successfully Implemented various IT Applications team throughout his career.
- Currently involved in AWS cloud migration design and Implementation but have previously worked on data - warehousing and big data projects and is looking forward to continuing to focus efforts across all of these realms.
- He is eagerly awaiting to see where the current "cloud" and "big data" waves bring to today's corporations and the businesses of tomorrow
TECHNICAL SKILLS
- Spark
- Python
- AWS Cloud
- Hadoop
- Oracle SQL
- IBM DataStage
- Data Warehousing:
PROFESSIONAL EXPERIENCE
Lead - Cloud Development Spark, Python
Confidential, Chicago, IL
Responsibilities:
- Develop ETL jobs using PySpark scripts with spark core/RDD, Dataframes, Spark SQL APIs
- Execute Scripts on Amazon Web Services Elastic Map Reduce AWS EMR
- Store and Retrieve data files on AWS Simple Storage Service S3
- Transfer data files to-and-fro Hadoop file system
- Read/write data on Cloud databases: Postgres, Redshift, Snowflake & no-prem Oracle
- Process various File types: JSON, Parquet, Text
- Utilize GitHub repository to manage Code & promote to QA & Prod
- Manage sprints stories/tasks progress on JIRA & active participation of Agile ceremonies
- Unit Test, debug and defect fix
- Lead activities:
- Delegation of tasks based on resource capability and skillset
- Review of Code, Test case and Test results
- Design change suggestions & fine-tuning code for performance improvement
Environment: Spark, Python, AWS S3 & EMR, Hadoop, Postgres, Oracle, Datastage, GitHub & Jira
Project Lead - Data warehouse & Bigdata
Confidential
Responsibilities:
- Import/Export data from Teradata, Oracle to Hadoop Bigdata Analytics using SqoopAnalise and transform data using Hive Queries
- Transfer data files to-and-fro Hadoop file system
- End-to-End ETL design and development (IBM DataStage)
- Oracle Dimensional Data Modeling, UNIX Shell Scripting
- Production Implementation and Scheduling (BMC Control-M)
- Map source data elements from various systems
- Develop, test, and support extraction, transformation and load processes.
- Led team team of 10+ handling multi location intra team out of India, Canada and USA
- Experience in contributing efforts on concurrent projects
Environment: Hadoop, Sqoop, Hive, Oracle, Datastage, ControlM and Unix
ETL Project Lead
Confidential, Minneapolis, MN
Responsibilities:
- Managing a team of 7 handling multi location intra team out of India and USA
- Involved in interaction with requirement analyst and business users from the USA, acquiring business requirements and provide analysis by understanding business features expected by clients and transforming them into technical specification documents
- Supporting Technical issue faced with Teradata, Datastage and Microstragegy
- Analysis of the business requirements and performing feasibility study
- Provided support to SIT/ UAT testing teams.
- Planning, Strategizing and Risk analysis of every project module
- Work allocation of every team member, onsite/customer/client SPOC
- Involved in detailed project estimation of the entire module
- Act as the first point of any offshore escalations and taking measures to mitigate the same
Environment: Teradata, Datastage, Microstrategy, ControlM and UNIX
ETL Lead Engineer
Confidential
Responsibilities:
- Supporting Technical issue faced with Teradata, Datastage and Microstragegy
- Analyze the requirements, Design of ETL/ELT process that extract information from source and process to foundation tables
- Tasks assignment team members based on skill and expertise, co-ordinate and manage team, scripts review, train team members on business requirements and technical skills, impart project overview to new joinee
- Risk identification and mitigation, load balancing, project schedule tracking, follow-up and feedback
- Meetings, presentations, mails and reports
Environment: PL/SQL ELT scripts, Shell Scripting, Teradata, Datastage, ControlM and UNIX
Tech Lead
Confidential
Responsibilities:
- Design, Development and Testing Application and Database
- PL/SQL scripts
- Troubleshoot PL/SQL
Environment: Java and Oracle PL/SQL scripts.
Software Developer
Confidential
Responsibilities:
- Testing PL/SQL scripts
Environment: Oracle PL/SQL scripts