[Swift-devel] [Swift-user] What system calls do the mappers use?

[Lorenzo Pesce]

> Just curious, what keyType values make sense? Not boolean or float, I assume.

They are strings, used later to locate files.

Basically there is a Sample (which is a structure), which among its parts has an array

type Sample{
   string sampleID;
   string dir;
   string [] RGfiles ;
}

I would then read it via a readData run (I am figuring out how to do that when the last thing to be read is an array whose length is unknown, but one problem at a time;-))




> Not arrays, files, structures either, I assume?  So really just int and strings are practical?

The ints, function calls and floats will come in later ;-)

> 
> Thanks,
> 
> - Mike
> 
> 
> ----- Original Message -----
>> From: "Mihael Hategan" <hategan at mcs.anl.gov>
>> To: "Michael Wilde" <wilde at mcs.anl.gov>
>> Cc: "Lorenzo Pesce" <lpesce at uchicago.edu>, "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>> Sent: Wednesday, March 20, 2013 4:52:17 PM
>> Subject: Re: [Swift-user] What system calls do the mappers use?
>> 
>> They are in trunk. They should also be in 0.94.
>> 
>> You declare them as:
>>  valueType[keyType] arrayName;
>> For example:
>>  int[string] a;
>>  a["one"] = 1;
>> 
>> Mihael
>> 
>> On Wed, 2013-03-20 at 16:04 -0500, Michael Wilde wrote:
>>> Lorenzo,
>>> 
>>> All Swift arrays are varying in size: you dont declare the array
>>> size in the declaration. Further, they can be sparse (because the
>>> implementation is in fact a hashtable).
>>> 
>>> Swift has code that supports user-level hashes by by declaring
>>> arrays with string instead of integer keys. I thought this made it
>>> to the User Guide but I see now that it did not. Its
>>> possible/likely thats because the code is not in trunk yet.
>>> 
>>> Can anyone on the devel team reply with the status of associative
>>> arrays?
>>> 
>>> Thanks,
>>> 
>>> - Mike
>>> 
>>> ----- Original Message -----
>>>> From: "Lorenzo Pesce" <lpesce at uchicago.edu>
>>>> To: "Michael Wilde" <wilde at mcs.anl.gov>
>>>> Cc: "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>>>> Sent: Wednesday, March 20, 2013 3:43:19 PM
>>>> Subject: Re: [Swift-user] What system calls do the mappers use?
>>>> 
>>>> Can one make hashes of arrays in or arrays of arrays of different
>>>> sizes in swift?
>>>> e.g., and array of an array type of variable size?
>>>> 
>>>> On Mar 20, 2013, at 3:41 PM, Michael Wilde wrote:
>>>> 
>>>>> 
>>>>> Also, to answer your question more directly: "I dont know".
>>>>> You
>>>>> can try to answer this by writing some very simple swift
>>>>> scripts
>>>>> that do the kinds of built-in mappings you are looking at, and
>>>>> use
>>>>> strace() wuth suitable filtering and grepping do see what Swift
>>>>> (via Java) is doing to implement the mapping.
>>>>> 
>>>>> Mihael may be able to point you to the Java classes that do the
>>>>> mapping to distill this process further.
>>>>> 
>>>>> - Mike
>>>>> 
>>>>> 
>>>>> ----- Original Message -----
>>>>>> From: "Lorenzo Pesce" <lpesce at uchicago.edu>
>>>>>> To: "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>>>>>> Sent: Wednesday, March 20, 2013 3:27:05 PM
>>>>>> Subject: [Swift-user] What system calls do the mappers use?
>>>>>> 
>>>>>> Hi --
>>>>>> 
>>>>>> I am working with mappers that might be repeated thousands of
>>>>>> times
>>>>>> in each workflow run.
>>>>>> Lustre doesn't like that type of search when it is based on
>>>>>> approaches similar to "ls", on the other hand "find" works
>>>>>> fine.
>>>>>> 
>>>>>> I could conceivably find a work around, but I would rather not
>>>>>> have
>>>>>> to do it.
>>>>>> 
>>>>>> Lorenzo
>>>>>> _______________________________________________
>>>>>> Swift-user mailing list
>>>>>> Swift-user at ci.uchicago.edu
>>>>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>>>>>> 
>>>> 
>>>> 
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>> 
>> 
>> 
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel