Automated Processing | Weather | Satellites | Energy | Finance

Projects

The projects below were performed for the following companies over many years. Some of these projects were performed as a contractor, some as an employee, and a few as both. Several of the companies have been bought and sold along the way, so we've used logos that were period correct at the time the projects were performed.

Weather

Companies: Citadel, Northern Trust, Aerojet

(In development) Automated NWS GFS pipeline to decode GRIB forecasts and deliver 1,000+ parameters and levels as SQL, CSV, Excel, HTML, and Google Earth products.
Built meteorology applications for an energy trading desk so weather, load, and price decisions used the same daily data feeds.
Extracted, translated, and loaded meteorological, gas-pipeline-flow, and energy-pricing (LMP) data from multiple public internet sources into Sybase ASE and IQ.
Developed supporting Perl applications on Solaris and Linux, using DBI, LWP, FTP, Excel, and email to pull, clean, and deliver the feeds.
Created a web-based error tracking and reporting system for market-data jobs so failed weather and price loads were easily identified.
Scheduled and supported the production suite with Tivoli Workload Scheduler, including pager and SMS coverage for thousands of daily jobs.
Produced visualization and validation software for DMSP microwave sensors, supported early-orbit operations on portable systems, and analyzed on-orbit satellite and sensor anomalies.

Satellites/Sensors

Companies: Hughes, Aerojet, USGS, RSI, Datron

Developed visualization software for satellite ground stations and developed code so new sensors could be processed; also built collection-request and order-processing systems.
Helped develop Landsat 7 Image Analysis System and a supporting suite of analytical and processing tools.
Built an IDL/ENVI and Perl/MySQL service that fetched current Landsat 7 Calibration Parameter Files (CPF) over sockets, so imagery ordered after a Scan Line Corrector failure could be updated as new CPFs were issued.
Created applications, GUIs, and tools for the hyperspectral Wedge Imaging Spectrometer covering processing, alignment, and material classification.
Developed MODIS algorithms and visual test-bed software for sensor analysis and validation.
Designed voxel-based visual databases and applications for the RealScene simulator used in target selection and terrain analysis.

Energy

Companies: Citadel, Delta Environmental Consultants

(In development) Building EIA and NYISO pipelines that pull fuels, RTO electricity, load, LMP, and generation data. Results will be delivered via SQL, CSV, Excel, HTML, and Google Earth products, including NYISO generator locations and real-time output.
Built a web-based project management and compliance system that tracked status and documentation for 20+ years of environmental projects.
Automated daily deadline and report emails with inline HTML and embedded Excel, including styled cells, hyperlinks, and calculated fields.
Developed ETL jobs for gas-pipeline-flow and locational marginal price (LMP) data used on an energy trading desk.
Built planned-versus-actual collection monitors so the energy desk could see, at a glance, which pipeline and vendor files had arrived that day.
Added capacity-aware disk rollover so the newest energy and pipeline datasets stayed on primary storage and older files moved off before the array filled.

Finance

Companies: Citadel, Northern Trust, TD BankNorth, Providian

Developed hedge-fund market-data applications that priced and maintained referential data from major vendors, including Bloomberg, Reuters, and J.P. Morgan.
Extracted, translated, and loaded financial feeds from multiple internet and vendor sources into Sybase using Perl DBI, LWP, FTP, Excel, and email delivery.
Scheduled and supported 1,500+ production applications (10,000+ daily runs) with Tivoli Workload Scheduler and Tidal Workload Automation, including pager coverage for the market-data suite.
Led development and scheduling for hedge-fund services applications across Sybase, SQL Server, and MySQL, using Scrum, Jira, and Git to deliver vendor file analysis, transfer, and ETL jobs.
Created an automated table builder that inferred database structures from incoming CSV, Excel, JSON, and vendor files so new financial feeds could be loaded without hand-built schemas.
Supported the energy trading desk with market-data ETL and collection-status monitors so pricing jobs and vendor feeds were visible when weather or pipeline files affected settlements.