Data, Meet Compute: NASA’s Cumulus Ingest Architecture

Abstract: NASA’s Earth Observing System Data and Information System (EOSDIS) houses nearly 30PBs of critical Earth Science data and with upcoming missions is expected to balloon to between 200PBs-300PBs over the next seven years. In addition to the massive increase in data collected, researchers and application developers want more and faster access – enabling complex visualizations, long time-series analysis, and cross dataset research without needing to copy and manage massive amounts of data locally…