This position will be responsible for the research, design, development, and implementation of enterprise systems related to Data Integration and Advanced Analytics. Will work on mission-critical data integration projects/systems such as Payroll, Financial system (D365), Enhanced Metering Program (EMP), 311, Accela, Lucity, and WAM. Will help manage the City’s fast-growing data Integration and Big Data Analytics platforms: Talend and Cloudera. The new employee will assist DoT and other City departments in meeting their data and analytics goals.
Preferred Skills: - Highly skilled in Talend Data Fabric: Talend Studio, Talend Data Integration, Talend Enterprise Service Bus, Talend Data Catalog, Talend Data Stewardship, Talend Data Preparation.
- Advanced knowledge of the following technologies: RDBMS platforms (Microsoft SQL Server), Cloudera Data Platform (i.e. Hadoop, Spark, kudu, etc.), Git, and SOAP/REST APIs.
- Highly proficient in developing data ingestion, data processing, and analytical pipelines for big data, data warehouses, relational, and NoSQL data solutions.
- Proficient in object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
- Experienced in translating business requirements to scalable technical solutions.
Under direction, is responsible for researching, designing, developing, and implementing enterprise software systems, which may include databases, server applications, and/or web-based development; performs related duties as required.
(Any one position may not include all of the duties listed, nor do the examples cover all of the duties that may be performed.)
Confers with departmental or divisional personnel to analyze current operational procedures, document potential problems, and identify specific input and output requirements for software system development;
Analyzes software requirements for computerization, such as hardware and network configurations, peripheral equipment, maintenance support, mainframe, or other system interfaces and memory devices to determine feasibility of system designs within time and budget constraints;
Reviews the outline of the new or revised business system process(es) and makes recommendations for improvements by defining the hardware and software requirements of the proposed system(s) or process(es); prepares cost estimates and project timelines for implementation;
Consults with technical staff to evaluate business processes, needs, expectations, and functional requirements and translates into technical requirements; designs and proposes solutions to streamline or enhance business functions/processes;
Researches third-party software systems for feasibility of design and compatibility and adaptability with existing architecture and business processes; reviews proposed hardware and software solutions and recommends selection to management for approval;
Formulates, designs, and/or modifies software systems using scientific analysis to predict and measure outcome and consequences of design;
Develops and directs software system testing procedures, programming, and documentation;
Serves as senior consultant for database design, implementation, and administration, including security, backup, recovery, and maintenance;
Advises departmental or divisional personnel in their technology needs with regard to data corruption, security issues, computer viruses, and hardware and software redundancy;
Consults with staff members to evaluate interface between hardware and software and operational and performance requirements of software system; analyzes system growth and evaluates processing efficiency;
Plans and prepares technical reports, memoranda, and instructional manuals as documentation of system development;
Makes recommendations to management regarding the planning, development, and coordination of software system development projects;
Performs engineering cost/benefit analysis to verify potential effectiveness of new products; conducts technical research for building new designs, developing business cases, selling ideas to management, and gaining commitment for new system enhancements;
Mentors business systems analysts and senior programmer analysts in their work and individual projects as requested by management;
Participates in appropriate professional activities to stay abreast of existing and emerging technologies.