[mpich-discuss] Segmentation Fault when running any application.

Thu Nov 17 10:10:28 CST 2011

Alright. Attached is the text file with the complete message from the
command: "c:\Program Files\MPICH2\bin\mpiexec" -verbose -n 2 hostname

I tried the other command and for some reason I am actually able to run the
program even when the errors occur. This is the response I got when running
the command:

C:\Users\Mike>"c:\Program Files\MPICH2\bin\mpiexec" -n 2 "C:\Program
Files\MPICH
2\examples\cpi.exe"
error closing the left context socket: Error = -1
Enter the number of intervals: (0 quits) 100
pi is approximately 3.1416009869231241, Error is 0.0000083333333309
wall clock time = 0.000541
Enter the number of intervals: (0 quits) 10
pi is approximately 3.1424259850010983, Error is 0.0008333314113051
wall clock time = 0.000047
Enter the number of intervals: (0 quits) 0
op_read error on left context: Error = -1
unable to read the cmd header on the left context, Error = -1
.
Error posting readv, An existing connection was forcibly closed by the
remote ho
st.(10054)

On Thu, Nov 17, 2011 at 9:56 AM, Jayesh Krishna <jayesh at mcs.anl.gov> wrote:

> Hi,
>  Yes, please give us the output of the command with "-verbose" turned on.
>  And for these tests, run mpiexec with the complete path ("c:\Program
> Files\MPICH2\bin\mpiexec" -verbose -n 2 hostname). Do you get the same
> error message when executing cpi ("c:\Program Files\MPICH2\bin\mpiexec" -n
> 2 "C:\Program Files\MPICH2\examples\cpi.exe")?
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" <michael.warthon at upr.edu>
> To: "Jayesh Krishna" <jayesh at mcs.anl.gov>
> Cc: mpich-discuss at mcs.anl.gov
>  Sent: Thursday, November 17, 2011 9:42:42 AM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
> For each command, this is the entire response that I get:
>
>
> C:\Users\Mike>mpiexec -validate
> SUCCESS
>
> C:\Users\Mike>mpiexec -n 2 hostname
> error closing the left context socket: Error = -1
>
> Mike-PC
> Mike-PC
> error closing the left context socket: Error = -1
>
> C:\Users\Mike>
>
>
> Did you want me to use the verbose option?
>
> On Thu, Nov 17, 2011 at 9:21 AM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> Please copy-paste the command and the response (the complete message) in
> your email.
> Are you able to validate the registered username/password (Type "mpiexec
> -validate" and it should return "SUCCESS")?
>
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
>
>
> Cc: mpich-discuss at mcs.anl.gov
> Sent: Thursday, November 17, 2011 7:50:25 AM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
> Ok. I have checked and yes smpd is running and I have given a sufficient
> username and password so that mpiexec will run. Now I am getting a new
> error when executing mpiexec -n 2 hostname where it is giving me this
> response:
>
> error closing the left context socket: Error = -1
>
>
> On Wed, Nov 16, 2011 at 2:21 PM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
>
> 1. Make sure that the process manager, smpd, is running in your system
> (Look in the task manager/Process Explorer to see if there is a service
> named smpd running. Alternately you can run "smpd -status" to check if smpd
> is running)
>
> 2. Run a simple non-MPI program like hostname from the command prompt
> using mpiexec (Type "mpiexec -n 2 hostname" ). When prompted for
> username/password give a valid Windows username/password.
> If mpiexec gives you an error, type "mpiexec -remove" to remove the
> existing registered username/password and then type "mpiexec -register" to
> register a new/valid Windows username/password. Re-run mpiexec.
>
> 3. Run the sample MPI program, cpi.exe, provided with MPICH2 (mpiexec -n 2
> C:\Progra~1\MPICH2\examples\cpi.exe)
>
> >> I am getting an error when I look at the MPICH2 configurable settings
> ...
>
> This is a known bug. Due to limited developer bandwidth we haven't been
> able to address this issue yet.
>
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
> Sent: Wednesday, November 16, 2011 12:27:01 PM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
>
> Alright. I have reinstalled MPICH2 using the method in section 9.4.
> However, I am not able to connect to the host it seems. I keep receiving
> this message when trying to execute a program:
>
>
>
> Credentials for Mike rejected connecting to Mike-PC
>
> Aborting: Unable to connect to Mike-PC
> Also, I am getting an error when I look at the MPICH2 configurable
> settings that says that MPICH2 is not installed or that it cannot query the
> host.
>
> On Wed, Nov 16, 2011 at 9:35 AM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> Looks like MPICH2 was not installed correctly in your system.
> Uninstall your existing version of MPICH2. Please follow the steps in
> Section 9.4 (Not 9.1 -
> http://www.mcs.anl.gov/research/projects/mpich2/documentation/files/mpich2-1.4.1-installguide.pdf) of the installer's guide to install MPICH2.
>
>
>
>
> (PS: I am assuming that you have Win7/Srv2008/...)
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
>
>
> Sent: Tuesday, November 15, 2011 9:04:57 PM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
> Yeah it must have been that I got the installation mixed up. I downloaded
> the windows installer and it finally compiled. So progess has been made as
> now I am getting this error when trying to run hello.exe:
>
>
>
> Error while connecting to host, No connection could be made because the
> target m
>
> achine actively refused it. (10061)
>
> Connect on sock (host=localhost, port=8676) failed, exhaused all end points
>
> Unable to connect to 'localhost:8676',
>
> sock error: Error = -1
>
>
> On Tue, Nov 15, 2011 at 5:12 PM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> There are two ways you can use MPICH2 on Windows+cygwin,
>
> # Download MPICH2 source compile/install it on Cygwin. Use mpicc to
> compile and use mpiexec (from this installation - NOT the one available
> with Windows installer) to run your program.
>
> # Download MPICH2 Windows installer, install MPICH2 (using installer gui).
> Use the cygwin/gcc libs provided with the Windows installation to compile
> your code. Use mpiexec from the Windows installation to run your job.
>
> Looks like you are mixing the approaches.
>
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
>
>
> Sent: Tuesday, November 15, 2011 1:03:02 PM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
> I was using mpicc in order to compile it. Unfortunately I am still not
> able to compile the code even with the command you gave me. I used:
>
> gcc -l/mpich_install/include -L/mpich_install/lib hello.c -lmpi
>
> I still received the same error. Did I install it incorrectly maybe?
>
> On Tue, Nov 15, 2011 at 12:42 PM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> How were you compiling your code before ?
> A command similar to,
>
> "gcc -I/cygdrive/c/Progra~1/MPICH2/include
> -L/cygdrive/c/Progra~1/MPICH2/lib hello.c -o hello.exe -lmpi"
>
> should work.
>
>
> Regards,
> jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
>
>
> Sent: Tuesday, November 15, 2011 12:18:43 PM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
> Alright. Well I tried it and for some reason it is not able to see the
> library.
> I used the command:
> gcc -g hello.c -L\mpich_install\lib -lmpi
>
> It ended up giving me an error saying:
> fatal error: mpi.h: No such file or directory
>
> On Tue, Nov 15, 2011 at 10:32 AM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> Try using gcc (usual gcc stuff: specify include dirs using "-I", lib dirs
> using "-L") to compile your code and link it with "-lmpi" .
>
>
> Regards,
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
>
>
>
> Sent: Tuesday, November 15, 2011 10:16:00 AM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
>
> What would be the correct command to use in cygwin in order to compile the
> code? Just want to make sure that I actually compiled it correctly.
>
>
> On Tue, Nov 15, 2011 at 10:10 AM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Hi,
> I just tried compiling your code with cygwin gcc (3.4.4) + MPICH2 1.4.1p1
> gcc libs and it worked for me (No seg fault, gives the expected output).
> Make sure that you are using the correct header files and libraries
> (MPICH2 libs and headers) when you compile your code.
>
> Regards,
>
> Jayesh
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
>
>
>
> To: "Jayesh Krishna" < jayesh at mcs.anl.gov >
> Sent: Tuesday, November 15, 2011 9:53:32 AM
> Subject: Re: [mpich-discuss] Segmentation Fault when running any
> application.
>
> Ah sorry. I forgot to include the p1 at the end of it. I am using mpich2
> 1.4.1p1
>
>
> On Tue, Nov 15, 2011 at 9:44 AM, Jayesh Krishna < jayesh at mcs.anl.gov >
> wrote:
>
>
> Did you try the latest stable release (1.4.1p1)?
>
> -Jayesh
>
>
> ----- Original Message -----
> From: "Michael Warthon" < michael.warthon at upr.edu >
> To: mpich-discuss at mcs.anl.gov
> Sent: Monday, November 14, 2011 7:54:43 PM
> Subject: [mpich-discuss] Segmentation Fault when running any application.
>
>
>
> Hello,
>
> I am new to MPI and I went and installed mpich2 1.4.1 onto a windows
> system that is being used through cygwin. I have compiled the code that
> simply prints the process and rank as shown below.
>
>
>
> #include <stdio.h>
> #include <mpi.h>
>
> int main( int argc, char *argv[]) {
>
> int numprocs, rank, namelen;
> char processor_name[MPI_MAX_PROCESSOR_NAME];
>
> MPI_Init(&argc, &argv);
> MPI_Comm_size(MPI_COMM_WORLD, &numprocs);
> MPI_Comm_rank(MPI_COMM_WORLD, &rank);
> MPI_Get_processor_name(processor_name, &namelen);
>
> printf( "Process %d on %s out of %d\n" , rank, processor_name, numprocs);
>
> MPI_Finalize();
> }
>
> Nothing too complicated. However, I still receive an error from the
> command line in cygwin that simply reads segmentation fault: (core dumped).
> The command I used was:
>
> mpiexec -n 1 a.exe
>
> No matter what executable I try to run, I still receive the same error.
> Any help regarding this would be greatly appreciated!
> _______________________________________________
> mpich-discuss mailing list mpich-discuss at mcs.anl.gov
> To manage subscription options or unsubscribe:
> https://lists.mcs.anl.gov/mailman/listinfo/mpich-discuss
>
>
>
>
>
>
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mcs.anl.gov/pipermail/mpich-discuss/attachments/20111117/fe0ba965/attachment-0001.htm>
-------------- next part --------------
...\smpd_get_full_path_name
....fixing up exe name: 'hostname' -> '(null)'
.../smpd_get_full_path_name
...handling executable:
hostname.exe
...Processing environment variables 
...Processing drive mappings
...Creating launch nodes (2)
...\smpd_get_next_host
....\smpd_get_next_hostname
..../smpd_get_next_hostname
....\smpd_get_host_id
..../smpd_get_host_id
.../smpd_get_next_host
...Adding host (Mike-PC) to launch list 
...\smpd_get_next_host
....\smpd_get_next_hostname
..../smpd_get_next_hostname
....\smpd_get_host_id
..../smpd_get_host_id
.../smpd_get_next_host
...Adding host (Mike-PC) to launch list 
...\smpd_create_cliques
....\prev_launch_node
..../prev_launch_node
....\prev_launch_node
..../prev_launch_node
....\prev_launch_node
..../prev_launch_node
....\prev_launch_node
..../prev_launch_node
.../smpd_create_cliques
...\smpd_fix_up_host_tree
.../smpd_fix_up_host_tree
../mp_parse_command_args
..host tree:
.. host: Mike-PC, parent: 0, id: 1
..launch nodes:
.. iproc: 1, id: 1, exe: hostname.exe
.. iproc: 0, id: 1, exe: hostname.exe
..\SMPDU_Sock_create_set
...\smpd_get_smpd_data
....\smpd_get_smpd_data_from_environment
..../smpd_get_smpd_data_from_environment
.../smpd_get_smpd_data
...\smpd_create_context
....\smpd_init_context
.....\smpd_init_command
...../smpd_init_command
..../smpd_init_context
.../smpd_create_context
...\SMPDU_Sock_post_connect
.../SMPDU_Sock_post_connect
...\SMPDU_Sock_set_user_ptr
.../SMPDU_Sock_set_user_ptr
...\smpd_make_socket_loop
....\smpd_get_hostname
..../smpd_get_hostname
.../smpd_make_socket_loop
...\SMPDU_Sock_native_to_sock
.../SMPDU_Sock_native_to_sock
...\SMPDU_Sock_native_to_sock
.../SMPDU_Sock_native_to_sock
...\smpd_create_context
....\smpd_init_context
.....\smpd_init_command
...../smpd_init_command
.....\SMPDU_Sock_set_user_ptr
...../SMPDU_Sock_set_user_ptr
..../smpd_init_context
.../smpd_create_context
...\SMPDU_Sock_post_read
....\SMPDU_Sock_post_readv
..../SMPDU_Sock_post_readv
.../SMPDU_Sock_post_read
...\smpd_enter_at_state
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_CONNECT event.error = 0, result = 0, context=left
....\smpd_handle_op_connect
.....connect succeeded, posting read of the challenge string
.....\SMPDU_Sock_post_read
......\SMPDU_Sock_post_readv
....../SMPDU_Sock_post_readv
...../SMPDU_Sock_post_read
..../smpd_handle_op_connect
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_READ event.error = 0, result = 0, context=left
....\smpd_handle_op_read
.....\smpd_state_reading_challenge_string
......read challenge string: '1.4.1p1 29358'
......\smpd_verify_version
....../smpd_verify_version
......Verification of smpd version succeeded
......\smpd_hash
....../smpd_hash
......\SMPDU_Sock_post_write
.......\SMPDU_Sock_post_writev
......./SMPDU_Sock_post_writev
....../SMPDU_Sock_post_write
...../smpd_state_reading_challenge_string
..../smpd_handle_op_read
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_WRITE event.error = 0, result = 0, context=left
....\smpd_handle_op_write
.....\smpd_state_writing_challenge_response
......wrote challenge response: 'a8ee9123d023137b56b395a15ace7129'
......\SMPDU_Sock_post_read
.......\SMPDU_Sock_post_readv
......./SMPDU_Sock_post_readv
....../SMPDU_Sock_post_read
...../smpd_state_writing_challenge_response
..../smpd_handle_op_write
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_READ event.error = 0, result = 0, context=left
....\smpd_handle_op_read
.....\smpd_state_reading_connect_result
......read connect result: 'SUCCESS'
......\SMPDU_Sock_post_write
.......\SMPDU_Sock_post_writev
......./SMPDU_Sock_post_writev
....../SMPDU_Sock_post_write
...../smpd_state_reading_connect_result
..../smpd_handle_op_read
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_WRITE event.error = 0, result = 0, context=left
....\smpd_handle_op_write
.....\smpd_state_writing_process_session_request
......wrote process session request: 'process'
......\SMPDU_Sock_post_read
.......\SMPDU_Sock_post_readv
......./SMPDU_Sock_post_readv
....../SMPDU_Sock_post_read
...../smpd_state_writing_process_session_request
..../smpd_handle_op_write
....sock_waiting for the next event.
....\SMPDU_Sock_wait
..../SMPDU_Sock_wait
....SOCK_OP_READ event.error = 0, result = 0, context=left
....\smpd_handle_op_read
.....\smpd_state_reading_cred_request
......read cred request: 'credentials'
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
.......\smpd_option_on
........\smpd_get_smpd_data
.........\smpd_get_smpd_data_from_environment
........./smpd_get_smpd_data_from_environment
.........\smpd_get_smpd_data_default
........./smpd_get_smpd_data_default
.........Unable to get the data for the key 'nocache'
......../smpd_get_smpd_data
......./smpd_option_on
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
......\SMPDU_Sock_post_write
.......\SMPDU_Sock_post_writev
......./SMPDU_Sock_post_writev
....../SMPDU_Sock_post_write
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_cred_ack_yes
.......wrote cred request yes ack.
.......\SMPDU_Sock_post_write
........\SMPDU_Sock_post_writev
......../SMPDU_Sock_post_writev
......./SMPDU_Sock_post_write
....../smpd_state_writing_cred_ack_yes
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_account
.......wrote account: 'Mike'
.......\smpd_encrypt_data
......./smpd_encrypt_data
.......\SMPDU_Sock_post_write
........\SMPDU_Sock_post_writev
......../SMPDU_Sock_post_writev
......./SMPDU_Sock_post_write
....../smpd_state_writing_account
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
.......\smpd_hide_string_arg
........\first_token
......../first_token
........\compare_token
......../compare_token
........\next_token
.........\first_token
........./first_token
.........\first_token
........./first_token
......../next_token
......./smpd_hide_string_arg
......./smpd_hide_string_arg
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
......\smpd_hide_string_arg
.......\first_token
......./first_token
.......\compare_token
......./compare_token
.......\next_token
........\first_token
......../first_token
........\first_token
......../first_token
......./next_token
....../smpd_hide_string_arg
....../smpd_hide_string_arg
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_process_result
.......read process session result: 'SUCCESS'
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_process_result
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_reconnect_request
.......read re-connect request: '3960'
.......closing the old socket in the left context.
.......\SMPDU_Sock_get_sock_id
......./SMPDU_Sock_get_sock_id
.......SMPDU_Sock_post_close(672)
.......\SMPDU_Sock_post_close
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./SMPDU_Sock_post_close
.......connecting a new socket.
.......\smpd_create_context
........\smpd_init_context
.........\smpd_init_command
........./smpd_init_command
......../smpd_init_context
......./smpd_create_context
.......posting a re-connect to Mike-PC:3960 in left context.
.......\SMPDU_Sock_post_connect
......./SMPDU_Sock_post_connect
....../smpd_state_reading_reconnect_request
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_CLOSE event.error = 0, result = 0, context=left
.....\smpd_handle_op_close
......\smpd_get_state_string
....../smpd_get_state_string
......op_close received - SMPD_CLOSING state.
......Unaffiliated left context closing.
......\smpd_free_context
.......freeing left context.
.......\smpd_init_context
........\smpd_init_command
......../smpd_init_command
......./smpd_init_context
....../smpd_free_context
...../smpd_handle_op_close
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_CONNECT event.error = 0, result = 0, context=left
.....\smpd_handle_op_connect
......\smpd_generate_session_header
.......session header: (id=1 parent=0 level=0)
....../smpd_generate_session_header
......\SMPDU_Sock_post_write
.......\SMPDU_Sock_post_writev
......./SMPDU_Sock_post_writev
....../SMPDU_Sock_post_write
...../smpd_handle_op_connect
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_session_header
.......wrote session header: 'id=1 parent=0 level=0'
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
.......\smpd_create_command
........\smpd_init_command
......../smpd_init_command
......./smpd_create_command
.......\smpd_post_write_command
........\smpd_package_command
......../smpd_package_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........smpd_post_write_command on the left context sock 736: 47 bytes for command: "cmd=start_dbs src=0 dest=1 tag=0 "
........\SMPDU_Sock_post_writev
......../SMPDU_Sock_post_writev
......./smpd_post_write_command
....../smpd_state_writing_session_header
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_cmd
.......wrote command
.......command written to left: "cmd=start_dbs src=0 dest=1 tag=0 "
.......moving 'start_dbs' command to the wait_list.
....../smpd_state_writing_cmd
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 170 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=result src=1 dest=0 tag=0 cmd_tag=0 cmd_orig=start_dbs kvs_name=B7012755-A677-4215-8DC3-17716BD7E056 domain_name=A4923245-E203-4332-81CD-25AE813AD331 result=SUCCESS "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = result
........ tag  = 0
........ ctx  = left
........ len  = 170
........ str  = cmd=result src=1 dest=0 tag=0 cmd_tag=0 cmd_orig=start_dbs kvs_name=B7012755-A677-4215-8DC3-17716BD7E056 domain_name=A4923245-E203-4332-81CD-25AE813AD331 result=SUCCESS 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_result
.........start_dbs succeeded, kvs_name: 'B7012755-A677-4215-8DC3-17716BD7E056', domain_name: 'A4923245-E203-4332-81CD-25AE813AD331'
.........\smpd_launch_processes
..........creating a process group of size 2 on node 0 called B7012755-A677-4215-8DC3-17716BD7E056
..........\create_process_group
........../create_process_group
..........launching the processes.
..........\smpd_create_command
...........\smpd_init_command
.........../smpd_init_command
........../smpd_create_command
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_post_write_command
...........\smpd_package_command
.........../smpd_package_command
...........\SMPDU_Sock_get_sock_id
.........../SMPDU_Sock_get_sock_id
...........smpd_post_write_command on the left context sock 736: 199 bytes for command: "cmd=launch src=0 dest=1 tag=1 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=1 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 "
...........\SMPDU_Sock_post_writev
.........../SMPDU_Sock_post_writev
........../smpd_post_write_command
..........\smpd_create_command
...........\smpd_init_command
.........../smpd_init_command
........../smpd_create_command
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_int_arg
........../smpd_add_command_int_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_add_command_arg
........../smpd_add_command_arg
..........\smpd_post_write_command
...........\smpd_package_command
.........../smpd_package_command
...........enqueueing write at the end of the list.
........../smpd_post_write_command
........./smpd_launch_processes
.........\smpd_free_command
..........\smpd_init_command
........../smpd_init_command
........./smpd_free_command
......../smpd_handle_result
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_cmd
.......wrote command
.......command written to left: "cmd=launch src=0 dest=1 tag=1 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=1 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 "
.......moving 'launch' command to the wait_list.
.......smpd_handle_written: posting write(199 bytes) for command: "cmd=launch src=0 dest=1 tag=2 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=0 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 "
.......\SMPDU_Sock_post_writev
......./SMPDU_Sock_post_writev
....../smpd_state_writing_cmd
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_cmd
.......wrote command
.......command written to left: "cmd=launch src=0 dest=1 tag=2 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=0 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 "
.......moving 'launch' command to the wait_list.
....../smpd_state_writing_cmd
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 134 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=result src=1 dest=0 tag=1 cmd_tag=1 cmd_orig=launch result=SUCCESS pg_id=B7012755-A677-4215-8DC3-17716BD7E056 pg_rank=1 pg_ctx=0 "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = result
........ tag  = 1
........ ctx  = left
........ len  = 134
........ str  = cmd=result src=1 dest=0 tag=1 cmd_tag=1 cmd_orig=launch result=SUCCESS pg_id=B7012755-A677-4215-8DC3-17716BD7E056 pg_rank=1 pg_ctx=0 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_result
.........successfully launched: 'cmd=launch src=0 dest=1 tag=1 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=1 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 '
.........\smpd_free_command
..........\smpd_init_command
........../smpd_init_command
........./smpd_free_command
......../smpd_handle_result
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 134 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=result src=1 dest=0 tag=2 cmd_tag=2 cmd_orig=launch result=SUCCESS pg_id=B7012755-A677-4215-8DC3-17716BD7E056 pg_rank=0 pg_ctx=1 "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = result
........ tag  = 2
........ ctx  = left
........ len  = 134
........ str  = cmd=result src=1 dest=0 tag=2 cmd_tag=2 cmd_orig=launch result=SUCCESS pg_id=B7012755-A677-4215-8DC3-17716BD7E056 pg_rank=0 pg_ctx=1 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_result
.........successfully launched: 'cmd=launch src=0 dest=1 tag=2 c=hostname.exe s=0 a=0 d=C:\Users\Mike p=C:\Windows\system32 q=0..1 i=0 n=2 k=B7012755-A677-4215-8DC3-17716BD7E056 kd=A4923245-E203-4332-81CD-25AE813AD331 '
.........root process launched, starting stdin redirection.
.........\smpd_make_socket_loop
..........\smpd_get_hostname
........../smpd_get_hostname
........./smpd_make_socket_loop
.........\SMPDU_Sock_native_to_sock
........./SMPDU_Sock_native_to_sock
.........\smpd_create_context
..........\smpd_init_context
...........\smpd_init_command
.........../smpd_init_command
...........\SMPDU_Sock_set_user_ptr
.........../SMPDU_Sock_set_user_ptr
........../smpd_init_context
........./smpd_create_context
.........\SMPDU_Sock_set_user_ptr
........./SMPDU_Sock_set_user_ptr
.........\SMPDU_Sock_post_read
..........\SMPDU_Sock_post_readv
........../SMPDU_Sock_post_readv
........./SMPDU_Sock_post_read
.........\smpd_free_command
..........\smpd_init_command
........../smpd_init_command
........./smpd_free_command
......../smpd_handle_result
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
.......smpd_stdin_thread started.
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 70 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=stdout src=1 dest=0 tag=3 rank=1 first=1 data=4D696B652D50430D0A "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = stdout
........ tag  = 3
........ ctx  = left
........ len  = 70
........ str  = cmd=stdout src=1 dest=0 tag=3 rank=1 first=1 data=4D696B652D50430D0A 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_stdout_command
.........\write_to_stdout
Mike-PC
........./write_to_stdout
......../smpd_handle_stdout_command
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 84 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=exit src=1 dest=0 tag=4 rank=1 code=0 kvs=B7012755-A677-4215-8DC3-17716BD7E056 "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = exit
........ tag  = 4
........ ctx  = left
........ len  = 84
........ str  = cmd=exit src=1 dest=0 tag=4 rank=1 code=0 kvs=B7012755-A677-4215-8DC3-17716BD7E056 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_exit_command
.........saving exit code: rank 1, exitcode 0, pg <B7012755-A677-4215-8DC3-17716BD7E056>
.........process exited without calling init.
.........process exited before anyone has called init.
......../smpd_handle_exit_command
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 70 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=stdout src=1 dest=0 tag=5 rank=0 first=1 data=4D696B652D50430D0A "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = stdout
........ tag  = 5
........ ctx  = left
........ len  = 70
........ str  = cmd=stdout src=1 dest=0 tag=5 rank=0 first=1 data=4D696B652D50430D0A 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_stdout_command
.........\write_to_stdout
Mike-PC
........./write_to_stdout
......../smpd_handle_stdout_command
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 84 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=exit src=1 dest=0 tag=6 rank=0 code=0 kvs=B7012755-A677-4215-8DC3-17716BD7E056 "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = exit
........ tag  = 6
........ ctx  = left
........ len  = 84
........ str  = cmd=exit src=1 dest=0 tag=6 rank=0 code=0 kvs=B7012755-A677-4215-8DC3-17716BD7E056 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_exit_command
.........saving exit code: rank 0, exitcode 0, pg <B7012755-A677-4215-8DC3-17716BD7E056>
.........process exited without calling init.
.........process exited before anyone has called init.
.........last process exited, returning SMPD_EXIT.
......../smpd_handle_exit_command
......./smpd_handle_command
.......\smpd_post_read_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........posting a read for a command header on the left context, sock 736
........\SMPDU_Sock_post_read
.........\SMPDU_Sock_post_readv
........./SMPDU_Sock_post_readv
......../SMPDU_Sock_post_read
......./smpd_post_read_command
.......\smpd_create_command
........\smpd_init_command
......../smpd_init_command
......./smpd_create_command
.......\smpd_post_write_command
........\smpd_package_command
......../smpd_package_command
........\SMPDU_Sock_get_sock_id
......../SMPDU_Sock_get_sock_id
........smpd_post_write_command on the left context sock 736: 43 bytes for command: "cmd=close src=0 dest=1 tag=3 "
........\SMPDU_Sock_post_writev
......../SMPDU_Sock_post_writev
......./smpd_post_write_command
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_WRITE event.error = 0, result = 0, context=left
.....\smpd_handle_op_write
......\smpd_state_writing_cmd
.......wrote command
.......command written to left: "cmd=close src=0 dest=1 tag=3 "
.......\smpd_free_command
........\smpd_init_command
......../smpd_init_command
......./smpd_free_command
....../smpd_state_writing_cmd
...../smpd_handle_op_write
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd_header
.......read command header
.......command header read, posting read for data: 31 bytes
.......\SMPDU_Sock_post_read
........\SMPDU_Sock_post_readv
......../SMPDU_Sock_post_readv
......./SMPDU_Sock_post_read
....../smpd_state_reading_cmd_header
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_READ event.error = 0, result = 0, context=left
.....\smpd_handle_op_read
......\smpd_state_reading_cmd
.......read command
.......\smpd_parse_command
......./smpd_parse_command
.......read command: "cmd=closed src=1 dest=0 tag=7 "
.......\smpd_handle_command
........handling command:
........ src  = 1
........ dest = 0
........ cmd  = closed
........ tag  = 7
........ ctx  = left
........ len  = 31
........ str  = cmd=closed src=1 dest=0 tag=7 
........\smpd_command_destination
.........0 -> 0 : returning NULL context
......../smpd_command_destination
........\smpd_handle_closed_command
.........closed command received from left child, closing sock.
.........\SMPDU_Sock_get_sock_id
........./SMPDU_Sock_get_sock_id
.........SMPDU_Sock_post_close(736)
.........\SMPDU_Sock_post_close
..........\SMPDU_Sock_post_read
...........\SMPDU_Sock_post_readv
.........../SMPDU_Sock_post_readv
........../SMPDU_Sock_post_read
........./SMPDU_Sock_post_close
.........received a closed at node with no parent context, assuming root, returning SMPD_EXITING.
......../smpd_handle_closed_command
......./smpd_handle_command
.......not posting read for another command because SMPD_EXITING returned
....../smpd_state_reading_cmd
...../smpd_handle_op_read
.....sock_waiting for the next event.
.....\SMPDU_Sock_wait
...../SMPDU_Sock_wait
.....SOCK_OP_CLOSE event.error = 0, result = 0, context=left
.....\smpd_handle_op_close
......\smpd_get_state_string
....../smpd_get_state_string
......op_close received - SMPD_EXITING state.
......\smpd_free_context
.......freeing left context.
.......\smpd_init_context
........\smpd_init_command
......../smpd_init_command
......./smpd_init_context
....../smpd_free_context
...../smpd_handle_op_close
..../smpd_enter_at_state
....calling SMPDU_Sock_finalize
....\SMPDU_Sock_finalize
..../SMPDU_Sock_finalize
....ReadFile failed, closing stdin reader thread.
.../main
...\smpd_exit
....\smpd_kill_all_processes
..../smpd_kill_all_processes
....\smpd_finalize_drive_maps
..../smpd_finalize_drive_maps
....\smpd_dbs_finalize
..../smpd_dbs_finalize
....\SMPDU_Sock_finalize
..../SMPDU_Sock_finalize