Intel Trace Analyzer and Collector Usage

tags: Intel, Profile, MPI

What is ITAC

ITAC (included in OneAPI) is a MPI tracer and analyer for intelmpi, if your program can be compiled with Intel MPI, then you can get a detailed MPI trace data by ITAC.

a itac result

How to use ITAC

setup for tracing

module use /scinet/intel/oneapi/2021u4/itac/latest/modulefiles
module load itac

export LD_PRELOAD=/scinet/intel/oneapi/2021u4/itac/latest/slib/libVT.so

config tracer

by Env

export VT_LOGFILE_FORMAT=stfsingle
export VT_PCTRACE=5
export VT_LOGFILE_NAME=...

by Config File

export VT_CONFIG=/home/l/lcl_uotiscscc/lcl_uotiscsccs1034/icon/hand/icon-intelmpi/build/experiments/exp_scc2850/scripts/itac.conf

Config Options

Just list some useful:

# This line will be ignored as a comment
CURRENT-DIR "/home/l/lcl_uotiscscc/lcl_uotiscsccs1034/icon/hand/icon-intelmpi/build/experiments/exp_scc2850/scripts" 
# The Intel Trace Collector uses the current working directory of the process that reads the configuration on all processes to resolve relative path names. You can override the current working directory with this option.


PCTRACE 5

# trace level normally use 5

PCTRACE-FAST on

# trace without check fails

MEM-MAXBLOCKS 16

# trace max block on memory

PROCESS 0:N OFF
# turn off trace for all core
PROCESS 1:N:10 on
# turn on trace for core #1,11,..10n+1 tile N

# by turning off trace for some cores can reduce the Memory usage and accelerate the trace speed.


TIME-WINDOWS 0:1, 420:720

# open trace for some time: from sec 0 to sec 1 and sec 420 to sec 720.

for more options you can find in Intel® Trace Collector User and Reference Guide

issues

oom

turn down the MEM-MAXBLOCKS and use less process to trace.

visualize ITAC result

traceanalyzer /path/to/collection/database/foo.stf