Skip to content

taps.executor.python

taps/executor/python.py

ProcessPoolConfig

Bases: ExecutorConfig

ProcessPoolExecutor plugin configuration.

Attributes:

  • max_processes (int) –

    Maximum number of processes.

  • context (Optional[Literal['fork', 'spawn', 'forkserver']]) –

    Multiprocessing context type (fork, spawn, or forkserver).

get_executor() 

get_executor() -> FutureDependencyExecutor

Create an executor instance from the config.

Source code in taps/executor/python.py 
39
40
41
42
43
44
def get_executor(self) -> FutureDependencyExecutor:
    """Create an executor instance from the config."""
    context = multiprocessing.get_context(self.context)
    return FutureDependencyExecutor(
        ProcessPoolExecutor(self.max_processes, mp_context=context),
    )

ThreadPoolConfig

Bases: ExecutorConfig

ThreadPoolExecutor plugin configuration.

Attributes:

  • max_threads (int) –

    Maximum number of threads.

get_executor() 

get_executor() -> FutureDependencyExecutor

Create an executor instance from the config.

Source code in taps/executor/python.py 
61
62
63
def get_executor(self) -> FutureDependencyExecutor:
    """Create an executor instance from the config."""
    return FutureDependencyExecutor(ThreadPoolExecutor(self.max_threads))