We provide IT Staff Augmentation Services!

Hadoop Architect & Senior Java Architect/developer Resume

0/5 (Submit Your Rating)

New, JerseY

SUMMARY

  • Core JAVA developer with 16+ Years experience and 8+ Years of Java Swing experience. Familiar with Multi - Threading, Concurrency, Low Latency, OOP & D, and Garbage Collection issues in Java.
  • Senior C Programmer with 25+ years experience on Windows, Linux, UNIX and Status/VOS.
  • Over 10 years of C++ experience and about 1 Year of C#/.NET exposure. Familiar with DataWindow, a database GUI plug-in which facilitates SQL Queries Display in the .NET Development environment. C++ Experience includes writing GUI’s using MOTIF on Sun Solaris Platform as well as using PThreads for Multi-Threading programs.
  • Well versed in Algorithms and Data Structures.
  • Conventional (SQL) Database experience with Sybase, MySQL, and Microsoft SQL Server.
  • NoSQL & Big Data experience with Hadoop including HDFS and Map-Reduce programming, Pig, Hive, HBase, Cassandra, Flume, Sqoop and Oozie. Also worked with R Programming.
  • Unix/Linux Shells include C Shell, Korn Shell, Bash Shell as well as Python and Perl Shell Scripting.
  • Management and Project Management experience with small groups.
  • Experience working with Equities, NASDAQ/OTC, Listed Bonds, Convertible Bonds, Listed Options, Commodities Options and Commodities. Experience includes extensive FIX protocol knowledge with various FIX Engines as well as writing Software for Price Distribution, Market Data Parsing and Processing.

TECHNICAL SKILLS

Languages: Java with Swing/AWT, JTable (Database Display with C.R.U.D. functionality) and Core Java. C Programming, PL/I and R programming. Experience with C++ and some C#Shells K Shell, C Shell, Bash shell and some Perl and Python.

SQL DB: Sybase, MS SQL, MySQL

NoSQL DB: Hadoop, HDFS, Map-Combiner-Reduce, PIG, HIVE, HBase, Cassandra, Flume, Sqoop and Oozie. UDF, UDAF and UDTF development experience.

O/S: Windows 7, UNIX - Solaris, Linux - Ubuntu, CentOS and Red Hat, Stratus - VOS, IBM VM

Software: Java Script, HTML, makefiles, cygwin, DB/Lib, JDBC, crontab, TradeWare FIX Engine (Source Code), Cameron Fix Engine, FIXEdge FIX Engine, QuickFix Fix Engine, QuickFix/J Fix Engine

Tools: Ant, Maven, MS Visual Studio for C# and C++, Eclipse, Jigloo, DataWindow, TIBCO Rendezvous.

Other: Apache, Tomcat, Visio, Log4j, UIMX, CVS, SVN, vi, emacs, JNI, JNA, XML

PROFESSIONAL EXPERIENCE

Confidential - New Jersey

Hadoop Architect & Senior Java Architect/Developer

Responsibilities:

  • Hadoop Architect & Java Developer - Consultant - Assisted Management with evaluating Hardware and Software for a Hadoop Cluster. Hardware evaluated was HP & Teradata. Software evaluated was Hortonworks’ HDP 2.2 distribution of Hadoop.
  • Installed Hadoop (Hortonworks HDP 2.2 = Hadoop 2.6.0) version on Evaluation Hardware (obtained at no cost), saving Confidential and Confidential $12,000 in installation costs. Hadoop Cluster consisted of 8 nodes, including 5 Data Nodes with 150 TB of raw Data Node Storage.
  • Provided Data Management staff with initial training in general Hadoop concepts and principles, Hive (HQL), Pig and HBase. Provided staff with an Eclipse IDE workspace containing template programs giving developers access to sample Mapper, Combiner and Reducer programs as well as sample UDF* Programs.
  • Later, upgraded all template programs initially set up to work with Hortonworks HDP 2.2 (Hadoop 2.6) to work with HDP 2.3 (Hadoop 2.7.1).
  • Installed Spark and MondoDB as tools for use with Hadoop.
  • Wrote Java Program to load MongoDB Data into Hive.
  • Designed and wrote Web Log Analysis process utilizing Hive and Netezza for SAS Analysts. Hive UDFs written to enhance Hive Data for SAS Analysts.
  • With managing Vice President, assisted in developing Documentation Standards for all projects in the “Data Management” group, which also managed Hadoop Development and Deployment at Bed, Bath and Confidential .
  • Documents which were standardized were High Level Design, Detailed Design, Source-Target Table Mapping (used by data Modelers) and Production Support Documents
  • Managed deployment of all 3 Hadoop Clusters at Bed, Bath and Confidential . 1 utilizing HP equipment (HW) and Hortonworks 2.2 (Software), and two other systems, one for production and one for development, utilizing Dell 7x0 Hardware from Teradata and Hortonworks HDP 2.3 Hadoop Distribution.
  • Responsible for all post installation configuration changes, such as changes to assure “compression on write”.

Confidential, Edison, NY

Hadoop Architect/Senior Java Developer

Responsibilities:

  • Hadoop Architect - Consultant - Designed, wrote, tested and implemented Map-Combiner-Reduce, Cassandra and HBase programs, PIG Latin Scripts, HIVE HQL, and Flume Configuration files. Projects worked on included ETL from native systems to Hadoop utilizing Hive for reporting, Pig for analysis or R Programming for statistical analysis. Wrote applications to perform Analysis to gain BI and also worked with Visualization of data via R Programming.
  • Wrote UDF, UDAF and UDTF Programs for Pig and Hive. These functions enabled data processing which is not possible using native Hive or Pig Latin.
  • Wrote a Java Swing program utilizing JTable to access Cassandra using Thrift, the DataStax API and the JDBC API to Cassandra.
  • Wrote a Java Properties configurable Java Swing Program to enable a user to Define Flume Sources, Sinks and Channels graphically, associate individual sets of Sources, Sinks and Channels to declare them as components of an Agent, and generate Flume Agent Configuration files.
  • Wrote Map-Combiner-Reduce Programs utilizing HDFS. Programs featured data Encryption for security and compression for efficient use of network resources. Worked closely with Firewall maintenance technicians and Network personnel in order to assure data security and access to sensitive data was available only to authorized personnel.
  • Wrote HBase Programs using careful row key design strategies to assure that minimal data is stored enabling HBase Scans that are efficient and conducive with the total Byte Ordering methodology which is native to HBase.
  • Installed Hadoop, Pig, HIVE, HBase, Flume, Solr, Sqoop, Oozie and Cassandra on Linux. Wrote applications or tools utilizing each of these products.
  • Statistical Analysis with R Programming enabling visualization of Statistical results. Reviewed College Statistics Texts for a more thorough understanding of how to program in R correctly.
  • Experience with MapR System Administration.
  • Exposure to Solr, Sqoop, Oozie and Avro.

Confidential, Staten Island, NY

Responsibilities:

  • Day Trading for income; self employed at this time.
  • Miscellaneous Java, Java Swing and C Programming. Purchased Jigloo © for development of Swing GUI’s.
  • Took this time to more thoroughly expand my knowledge on new technologies such as Big Data and technologies within Java.

Confidential, NY and Warren, NJ

Senior Programmer Analyst

Responsibilities:

  • Wrote Documentation to specify how existing and new FIX Protocol Type messages would be constructed, possibly modified and delivered via an MQ Series Message Bus in order to report on Security types, some not previously handled and to facilitate additional Data Processing and Functionality with existing security types.
  • Discussed with Developers how a series of existing Applications would or should be changed in order to handle new Security types, as well as suggesting new ancillary applications necessary to pre or post process new fields and the data associated with them.

Confidential, Weehawken, NJ

Senior Programmer Analyst

Responsibilities:

  • Wrote a Project Plan using Microsoft Project in order to:
  • Know what Tasks must be completed for the project
  • Label all Prerequisites tasks.
  • Define the Critical Path for the Project.
  • Coordinate the tasks, via time, for work to be performed by various groups including the Network group, Production Support, Software Developers (Software implementers), etc.
  • Held discussions with managers of existing applications which consisted of C, C++ and Java programs in order to add communications routines to handle the new Production and Backup locations. These locations were in different cities and coding for them was done by local programs. I handled the local programs in Weehawken, NJ.

Confidential

Senior Programmer Analyst

Responsibilities:

  • Performed Fix Engine Compatibility tests. Responsible for implementation and production support of all FIX Interfaces. FIX Engine used was FIXEdge. Used QuickFix/J for development.
  • Worked with Network Engineers to establish connectivity to New Customers who would be Routing Order Flow either towards or away from the firm.
  • Production support for FIX Interfaces included analysis of In and Out Bound Fix Logs in order to troubleshoot Order or Executions issues, OATS reporting problems or any type of problem originating with FIX Orders and Execution messages.
  • Production Support for a Profit & Loss System, which was MySQL on the database side and C# on the Front End using Sybase’s Data Window product. MySQL was running on the Ubuntu Linux Operating System. This system was used primarily as a Trader payment calculator.
  • Wrote, maintained and supported a Problem Resolution System using 100% Java, Swing and MySQL.
  • Wrote Java Programs to Parse Bloomberg EOD Data to create Composite Pricing Data in user specified time intervals for Trading Analytics applications running downstream.
  • Modified Existing C++ program to in corporate Multiple Threads to facilitate generation of Orders from incoming Natural IOI messages. Objective was to exhaust existing Liquidity identified in IOI messages.
  • Wrote HTML Web applications which allow for the selective extraction and translation of raw FIX Messages into paragraphs of English Sentences. This was done primarily for use by Help Desk personnel to resolve Trading problems on an as needed basis.

Environment: Java, Sybase, Transact SQL, Java Swing, C++, C#, DataWindow, Visual Studio, Eclipse, MySQL, FIX Protocol, FixEdge Fix Engine, QuickFixJ, Windows Batch Files, BASH and C Shells, vi within Cygwin.

Confidential

FIX Protocol Consultant

Responsibilities:

  • Wrote Custom Software to modify orders, per customer specifications or routed orders internationally, depending on the Trading Exchange specified on incoming orders in real-time.
  • The API was capable of connecting to multiple Trading Systems simultaneously and routing orders between the systems in a customized way. In a sense, the FIX API was also, in part, an order router.
  • The routing was between Jersey City, New Jersey, Berlin, Germany and Toronto, Canada.
  • Real Time Order and Execution data was constantly being duplicated to assure minimal issues with the use of the failover system.
  • System used ‘Components’ driven by configuration files to communicate with the Trading Systems or with customers. The implementation included a Browser Based Administrative support system.
  • The retransmission mechanism was ‘smart’ in that retransmissions could be selected based on criteria in the message and not solely on their sequence numbers.
  • The Order Flow could be altered based on previously agreed upon customer specified modifications. The Order flow could also be routed to multiple trading systems, even a trading system in another country depending on client specifications.
  • At this firm, the trading system in use was BRASS©, the development system was Eclipse running on an HP Pavilion ZD8000 Laptop and the Hardware used in Production were PC’s running the LINUX operating system.
  • Technologies used: Java and C++ running on Linux and Sybase running on UNIX. The FIX Servers ran Tomcat Web Servers on Linux to implement the Browser based Administration tools functionality. Korn and Bash Shells were used for controlling executables. HTML was written for the Browser based administration tool. Fault Tolerance was implemented via CSM.

Environment: BRASS, Java, C++, Windows, Sybase, JDBC, DB/Lib, Eclipse, HTML, Tomcat, FIX Protocol, QuickFix, vi within Cygwin.

Confidential - Jersey City, NJ

Senior Programmer Analyst

Responsibilities:

  • Responsibilities included managing all FIX Order Flow into and out of the firm. This FIX messaging was done via a FIX to BRASS© API application. This application was capable of order modification before delivering the orders into the trading system. Multi-Threaded Fix Sessions were managed using QuickFix Engine.
  • Under certain conditions, the interface executed portions of orders upon arrival, based on criteria negotiated with the customer. In other cases, the Trading system was instructed to forward part of the order to ECN’s for enhanced liquidity.
  • Additional functionality included automated trading at the market for selected customers sending high volume orders, again, based on previously negotiated Order Handling instructions.
  • The FIX API was connected to the BRASS© Trading System, available from Sungard Trading Systems.
  • Responsibilities also included writing programs to enable communication between the FIX API and a new Trading System being developed by a consultant. The intention was to prepare the same FIX Front end to customers, while using this new Trading system on the Broker/Dealer Side.

Environment: BRASS, Java, C++, Windows, Sybase, DB/Lib, Eclipse, HTML, Tomcat, FIX Protocol, QuickFix, VI (editor) used on Linux (Ubuntu) Operating System. XML and JNI used with QuickFix Engine.

Confidential, Jersey City, New Jersey

Strategic Systems Manager

Responsibilities:

  • Responsibilities included managing personnel involved in the development of a Java GUI product which enabled Small Broker Dealers to remotely send orders via a Browser based application over the internet.
  • Responsible for the TradeWare FIX software implementation, coding, upgrading and production support for the firm. This was the firm’s first FIX engine.
  • Developed and supported the Java based Cameron Systems FIX Engine after Confidential decided to migrate away from TradeWare’s FIX Engine.
  • Responsible for the design, testing, implementation and production support of a Motif Based GUI for sending Indication of Interest, Email and News messages using the FIX 4.0 protocol.
  • Designed, wrote and managed Applications using Applix, a UNIX based product intended to compete with Microsoft Office. It had components which allowed users to write Documents, Spreadsheets, Graphic Displays (similar to Power Point) and standardized access to database products such as Sybase and Oracle.
  • Modified an existing Java Based FIX Engine by adding TIBCO library calls for Indication of Interest message distribution throughout the list of Institutional firms with which we did business.
  • Wrote a Motif GUI for sending IOI messages. The Application was written in C using the UIMX Motif GUI Builder. This application was used primarily by the Institutional Desk.
  • The Trading System used at this firm was BRASS©, then available from what was then known as Automated Securities Corporation, Inc. . It is now known as Sungard Trading Systems.

Environment: BRASS, Java, C++, Windows, Sybase, DB/Lib, Transact SQL, Eclipse, HTML, Tomcat, FIX Protocol, QuickFix, VI (editor) on Solaris (Unix) Operating System.

Confidential

Manager

Responsibilities:

  • Assistant Vice President. Technical manager of 3 persons. With this staff, responsibilities included complete support of the Convertible Bonds Trading Desk, Retail Options Trading Desk and the transmission of IOI FIX messages.
  • Applications were written in C and C++. The database used was Sybase System 10 with DB-Library. UNIX shells used were Korn and C shell.
  • Motif Applications were developed using UIMX, a MOTIF GUI builder. Network Applications were written using native C Language calls for direct access to TCP/IP messaging. Use the Trinitech FIX C++ Library and servers.
  • FIX: Updated the FIX Application to allow messages to be routed to our mainframes Order Management System for automatic execution. This program was capable of operating as a client (with window, buttons, etc) or as a standalone server. It was implemented in New York and Boston. This application used Korn shells, Sybase, DB-Lib, Motif and C++. The FIX Engine used was from Trinitech and was accessed via a series of calls to a C++ Library.
  • Convertible Bonds Desk: Designed and wrote Applix Spreadsheets using Dialog Boxes written using a proprietary macro language with Motif Window capability and Sybase database access routines. Applix has its' own Sybase OpenServer and can interface with the Reuters SSL Real Time data distribution system.
  • Applix Macro’s were written to access Tech Hackers @Analyst Bond/MBS/Options Spreadsheet Functions and the subroutines written in High Level Programming languages (such as C/C++) from any component of the Applix Application suite.
  • Retail Options Trading Desk: Managed the development of an application which allowed third party options trades to be archived, reported on, corrected and maintained using C++/Motif, Korn shell and Sybase.

Confidential

Assistant Vice President

Responsibilities:

  • Assistant Vice President responsible for a Real Time Price Delivery System using MOTIF on the SunOS/Unix operating system.
  • Responsible for a STRATUS based Real Time Pricing Ticker Plant used to parse Market Data in Real Time and maintain a memory resident Pricing database.
  • Responsibilities included obtaining user requirements, designing, writing, testing and implementing applications which deliver market data in Real Time. This requires extensive use of TCP/IP socket applications as well as data retrieval via an API from the TDBS database, a proprietary database product available from TeleKurs.
  • Wrote network applications using TCP/IP, UDP/IP and FTP on Sun/Unix, Stratus/VOS and IBM/VM.
  • Responsible for researching, recommending, configuring, testing and implementing hardware to allow an IBM VM mainframe to connect to a LAN (IBM 3172). Programming languages used on VM were PL/1 and Pascal. Command Line language used was called REXX.
  • 4+ years experience in the Stratus/VOS operating system. Programming Languages used were PL/1 and C.
  • Wrote parsers, database update routines and utility programs as necessary. Used the Forms Management System (FMS), Transaction Processing Facility (TPF) and vendor supplied applications using shared memory.
  • Responsible for an IBM System/36 used as a local printing substation via MSRJE. Printers used were IBM models 5262 and 4245.
  • Wrote an application to print customer billing statements on an IBM 3827 printer. Languages used were PL/I, COBOL, REXX and EXEC2.

We'd love your feedback!