Smart data staging based on scheduling policy

摘要

An embodiment includes selecting a job to upload to a remote system, uploading a portion of data for the job to the remote system, and receiving notice that the portion of data for the job has been staged at the remote system. The embodiment also includes, based on the portion of data being staged, instructing the remote system to begin performing operations for the job on the portion of the data, where after the remote system begins to perform the operations for the job on the portion of data prior to all data for the job being uploaded. From an alternate perspective an embodiment includes receiving a description of a job to be performed on data, receiving a portion of the data, receiving an instruction to begin performing computations on the portion of data, and beginning to perform identified computations on the portion of data before receiving all the data.