Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

How to use

SysGPT is a GPT-4o based model fine-tuned using OpenAI’s API. Because of the API’s usage-based pricing, we cannot make the model publicly accessible without incurring usage costs. As a result, we are unable to host or deploy it directly. Instead, we release our training data, evaluation methodology, and benchmarks used in the paper through the resources below.

Available Resources

To reproduce or experiment with SysGPT’s methodology-aware behavior, refer to the open repository:

🔗 https://github.com/sslab-gatech/SysGPT

This includes:

  • The full training and test dataset used during fine-tuning
  • Benchmarks and scenarios described in the paper’s evaluation
  • Sample task sequences and GPT input formats
  • Qualitative and quantitative evaluation results

Reproducing Results

SysGPT was evaluated in the original paper using two approaches:

  • Section 5.2 – Qualitative Measurements
    Model responses were assessed for structure-awareness and alignment with the intended methodology.

  • Section 5.3 – Quantitative Measurements
    Suggestions were benchmarked in controlled environments to measure potential improvements in throughput and latency.

These sections can serve as a reference when applying the methodology to your own systems or when evaluating the model’s performance on new workloads.