[Swift-devel] [Swift-user] What system calls do the mappers use?
Lorenzo Pesce
lpesce at uchicago.edu
Wed Mar 20 18:24:24 CDT 2013
Hashes are in the guide.
You have a point, if they are all hashtables anyway, it makes little difference.
I will try to work this into the code tomorrow.
I will also figure out how to run a function passing to it an array input.
BTW, the tests done so far with the new approach for the GS problem worked very well. We did a medium 740,000 job and it went through without a hitch.
On Mar 20, 2013, at 4:59 PM, Michael Wilde wrote:
> Did this all out of the User Guide or did it never get in there?
>
> Either way, could you (or better yet, Yadu) add it (back)?
>
> Just curious, what keyType values make sense? Not boolean or float, I assume.
>
> Not arrays, files, structures either, I assume? So really just int and strings are practical?
>
> Thanks,
>
> - Mike
>
>
> ----- Original Message -----
>> From: "Mihael Hategan" <hategan at mcs.anl.gov>
>> To: "Michael Wilde" <wilde at mcs.anl.gov>
>> Cc: "Lorenzo Pesce" <lpesce at uchicago.edu>, "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>> Sent: Wednesday, March 20, 2013 4:52:17 PM
>> Subject: Re: [Swift-user] What system calls do the mappers use?
>>
>> They are in trunk. They should also be in 0.94.
>>
>> You declare them as:
>> valueType[keyType] arrayName;
>> For example:
>> int[string] a;
>> a["one"] = 1;
>>
>> Mihael
>>
>> On Wed, 2013-03-20 at 16:04 -0500, Michael Wilde wrote:
>>> Lorenzo,
>>>
>>> All Swift arrays are varying in size: you dont declare the array
>>> size in the declaration. Further, they can be sparse (because the
>>> implementation is in fact a hashtable).
>>>
>>> Swift has code that supports user-level hashes by by declaring
>>> arrays with string instead of integer keys. I thought this made it
>>> to the User Guide but I see now that it did not. Its
>>> possible/likely thats because the code is not in trunk yet.
>>>
>>> Can anyone on the devel team reply with the status of associative
>>> arrays?
>>>
>>> Thanks,
>>>
>>> - Mike
>>>
>>> ----- Original Message -----
>>>> From: "Lorenzo Pesce" <lpesce at uchicago.edu>
>>>> To: "Michael Wilde" <wilde at mcs.anl.gov>
>>>> Cc: "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>>>> Sent: Wednesday, March 20, 2013 3:43:19 PM
>>>> Subject: Re: [Swift-user] What system calls do the mappers use?
>>>>
>>>> Can one make hashes of arrays in or arrays of arrays of different
>>>> sizes in swift?
>>>> e.g., and array of an array type of variable size?
>>>>
>>>> On Mar 20, 2013, at 3:41 PM, Michael Wilde wrote:
>>>>
>>>>>
>>>>> Also, to answer your question more directly: "I dont know".
>>>>> You
>>>>> can try to answer this by writing some very simple swift
>>>>> scripts
>>>>> that do the kinds of built-in mappings you are looking at, and
>>>>> use
>>>>> strace() wuth suitable filtering and grepping do see what Swift
>>>>> (via Java) is doing to implement the mapping.
>>>>>
>>>>> Mihael may be able to point you to the Java classes that do the
>>>>> mapping to distill this process further.
>>>>>
>>>>> - Mike
>>>>>
>>>>>
>>>>> ----- Original Message -----
>>>>>> From: "Lorenzo Pesce" <lpesce at uchicago.edu>
>>>>>> To: "Swift User Discussion List" <swift-user at ci.uchicago.edu>
>>>>>> Sent: Wednesday, March 20, 2013 3:27:05 PM
>>>>>> Subject: [Swift-user] What system calls do the mappers use?
>>>>>>
>>>>>> Hi --
>>>>>>
>>>>>> I am working with mappers that might be repeated thousands of
>>>>>> times
>>>>>> in each workflow run.
>>>>>> Lustre doesn't like that type of search when it is based on
>>>>>> approaches similar to "ls", on the other hand "find" works
>>>>>> fine.
>>>>>>
>>>>>> I could conceivably find a work around, but I would rather not
>>>>>> have
>>>>>> to do it.
>>>>>>
>>>>>> Lorenzo
>>>>>> _______________________________________________
>>>>>> Swift-user mailing list
>>>>>> Swift-user at ci.uchicago.edu
>>>>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>>>>>>
>>>>
>>>>
>>> _______________________________________________
>>> Swift-user mailing list
>>> Swift-user at ci.uchicago.edu
>>> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-user
>>
>>
>>
> _______________________________________________
> Swift-devel mailing list
> Swift-devel at ci.uchicago.edu
> https://lists.ci.uchicago.edu/cgi-bin/mailman/listinfo/swift-devel
More information about the Swift-devel
mailing list