pyabc_split Namespace Reference

Data Structures
class	_splitter
class	abc_state

Functions
def	_retry_select
def	make_splitter
def	split_all_full
def	defer
def	split_all
def	temp_file_names
def	abc_split_all
def	f_1
def	f_2
def	f_3
def	abc_f

Variables
tuple	t_1 = (f_1, [1])
tuple	t_2 = (f_2, [1,2])
tuple	t_3 = (f_3, [1,2,3])
list	funcs = [t_1, t_2, t_3]
	best = None

Detailed Description

module pyabc_split

Executes python functions and their arguements as separate processes and returns their return values through pickling. This modules offers a single function:

Function: split_all(funcs)

The function returns a generator objects that allowes iteration over the results,

Arguments:

funcs: a list of tuples (f, args) where f is a python function and args is a collection of arguments for f.

Caveats:

1. Global variables in the parent process are not affected by the child processes.
2. The functions can only return simple types, see the pickle module for details

Usage:

Assume you would like to run the function f_1(1), f_2(1,2), f_3(1,2,3) in different processes. 

def f_1(i):
return i+1

def f_2(i,j):
return i*10+j+1

def f_3(i,j,k):
return i*100+j*10+k+1

Construct a tuple of the function and arguments for each function

t_1 = (f_1, [1])
t_2 = (f_2, [1,2])
t_3 = (f_3, [1,2,3])

Create a list containing these tuples:

funcs = [t_1, t_2, t_3]

Use the function split_all() to run these functions in separate processes:

for res in split_all(funcs):
print res

The output will be:

2
13
124

(The order may be different, except that in this case the processes are so fast that they terminate before the next one is created)

Alternatively, you may quite in the middle, say after the first process returns:

for res in split_all(funcs):
print res
break

This will kill all processes not yet finished.

To run ABC operations, that required saving the child process state and restoring it at the parent, use abc_split_all().

import pyabc

def abc_f(truth):
    import os
    print "pid=%d, abc_f(%s)"%(os.getpid(), truth)
    pyabc.run_command('read_truth %s'%truth)
    pyabc.run_command('strash')
    
funcs = [
    defer(abc_f)("1000"),
    defer(abc_f)("0001")
]

for _ in abc_split_all(funcs):
    pyabc.run_command('write_verilog /dev/stdout')

Author: Baruch Sterin <sterin@berkeley.edu>

Function Documentation

def pyabc_split._retry_select (   rlist )

private

Definition at line 99 of file pyabc_split.py.

def _retry_select(rlist):
    while True:
        try:
            rrdy,_,_ = select.select(rlist,[],[])
            if rrdy:
                return rrdy
        except select.error as e:
            if e[0] == errno.EINTR:
                continue
            raise