Skip to content

Classes, enums and types used to configure Inplace Optimize

model_navigator.InplaceConfig 

InplaceConfig()

Inplace Optimize configuration.

Initialize InplaceConfig.

Source code in model_navigator/inplace/config.py 
53
54
55
56
57
58
def __init__(self) -> None:
    """Initialize InplaceConfig."""
    self._cache_dir: pathlib.Path = inplace_cache_dir()
    self._min_num_samples: int = DEFAULT_MIN_NUM_SAMPLES
    self._max_num_samples_stored: int = DEFAULT_MAX_NUM_SAMPLES_STORED
    self.strategies: List[RuntimeSearchStrategy] = [MaxThroughputAndMinLatencyStrategy(), MinLatencyStrategy()]

cache_dir property writable 

cache_dir

Get the cache directory.

max_num_samples_stored property writable 

max_num_samples_stored

Get the minimum number of samples to collect before optimizing.

min_num_samples property writable 

min_num_samples

Get the minimum number of samples to collect before optimizing.