Model Application Performance on a Custom Target GPU Device

Use the Modeling Parameters Pane

When you open the Summary tab of the Offload Modeling report in the Intel Advisor GUI or the interactive HTML report, you should see the Modeling Parameters pane, which shows the current modeled device and its parameters. Each parameter is a slider you can move to change its value.

You can use this pane to:

• Examine device parameters that the application performance was modeled on to understand how they affect the estimated performance.
• Change the target device to compare the new configuration with the current modeled device.
• Adjust the parameters and remodel performance for a custom device. You can experiment with parameters to see how they affect the application performance or adjust the configuration to model performance for a future or a specific device not listed in the target devices. See the sections below for a full workflow.

  For CPU-to-GPU modeling, you can remodel performance using Intel Advisor CLI only.

For details about pane controls. see Window: Offload Modeling Summary.

Remodel Performance from GUI

This workflow is currently available for remodeling from a baseline GPU to a different target GPU device using Intel Advisor GUI. You can remodel application performance for the custom device from the Offload Modeling report.

Prerequisites:

1. Set up system to analyze GPU kernels.
2. Run Offload Modeling with your preferred method: from graphical user interface or from command line interface.
3. Open the result in the Intel Advisor GUI.

To customize the hardware parameters and remodel application performance:

1. In the Analysis Workflow pane, make sure GPU device is selected in the Baseline Device drop-down.
2. Optional: In the Modeling Parameters pane of the Summary report, select a device from the Target Device drop-down to use as a baseline for further changes.

   If you do not change the device, the current modeled target device will be used a baseline.

3. Move the sliders under Hardware Parameters to the desired values. The black line indicates the baseline parameter value, and the blue line indicates the difference between the new value and the baseline value.

   For example, you can increase the number of execution units EU Count to enable more compute operations to be executed at once. This can be useful for compute-bound applications, which is indicated in the Offload Bounded By pane.

   

4. Click button at the top of the pane to run the Performance Modeling analysis for your target device configuration.

   When the analysis execution completes, the result estimated for the custom device configuration opens.

5. Examine the performance changes for the new target GPU.

   For example, if you increased the EU count value, you may see the compute time and compute bound percentage decreased and compute estimate metrics changed.

Remodel Performance Using a Configuration File

This workflow is currently available for remodeling performance:

• From a baseline CPU to a custom GPU using Intel Advisor GUI or an interactive HTML report
• From a baseline GPU to a custom GPU using an interactive HTML report

For these cases, you can modify the parameters using Offload Modeling report and remodel performance using Intel Advisor CLI only.

Prerequisites:

1. Set up environment variables.
2. Run Offload Modeling with your preferred method: from graphical user interface or from command line interface.
3. Open the result in the Intel Advisor GUI on an interactive HTML report.

To customize the hardware parameters and remodel application performance:

1. Optional: In the Modeling Parameters pane of the Summary report, select a device from the Target Device drop-down to use as a baseline for further changes.

   If you do not change the device, the current modeled target device will be used a baseline.

2. Move the sliders under Hardware Parameters to the desired values. The black line indicates the baseline parameter value, and the blue line indicates the difference between the new value and the baseline value.

   For example, you can increase the number of execution units EU Count to enable more compute operations to be executed at once. This can be useful for compute-bound applications, which is indicated in the Offload Bounded By pane.

   

   After you move a slider, the Save to Remodel button activates, enabling you to save your custom configuration.

   Note

   Currently, for the CPU-to-GPU modeling, if you change the memory-related parameters, such as bandwidth or size, run the Characterization analysis first with Trip Counts and multi-device cache simulation (for CLI, run Trip Counts collection with --cache-simulation=multi option) before running the Performance Modeling with the custom configuration. Otherwise, the results may not be accurate because they require updating cache simulation for the new device.
3. Click Save to Remodel to save the generated configuration file.

   The Save Configuration dialog box opens.

4. In the opened dialog box, navigate to a location to save the TOML file, change the file name if needed, and click Save. By default, the file is saved as config.toml.

   After you save the custom configuration file, a command line for the Performance Modeling analysis appears under the hardware parameter sliders in the Modeling Parameters pane.

   

5. Click to copy the command line generated under the hardware parameters to a clipboard.

   Notice that the command line has a --custom-config option with a full path to the custom configuration file you saved. The command line has all required options, and you can copy and paste it without modifications.

6. Paste the copied command to a terminal or a command prompt and run it.

   After the analysis execution completes, the result in your project directory will be updated for the new target device configuration.

7. Open the updated results with your preferred method and examine the performance changes for the new target GPU.

   For example, if you increased the EU count value, it you may see the compute time and compute bound percentage decreased and compute estimate metrics changed.

Remodel Performance Using a Command Line Option

When you run the Offload Modeling perspective from the command line, you can use the --set-parameter=<parameter-to-change> option to change target parameters. You can use this option with the Offload Modeling collection preset or the Performance Modeling analysis. This is a one-time change applied only for the current execution. You can specify more than one parameter as a comma-separated list.

For example, you can model performance for a target device with 1.4 GHz frequency, 224 execution units, and other parameters corresponding to the gen12_tgl device configuration as following:

advisor --collect=offload --config=gen12_tgl --set-parameter="EU_count=224,Frequency=1.4e+9" --project-dir=./advi_results -- ./myApplication

You can open the generated results with your preferred method and examine the performance changes for the new target GPU.

To see what parameters you can change, you can save a configuration file for a selected device from Intel Advisor GUI or HTML report and examine the parameters listed.