alioth.debian.org

[mictadlo]

Hello,
Could you write code for http://alioth.debian.org/scm/viewvc.php/shootout/bench/?root=shootout examples. This will show where are problems and also for newbies to understand the language better.

[JeffBezanson]

It would be great to have these, but there are a lot of benchmarks there and we're probably not going to budget time to go through and implement all of them. It will probably take a group of people over a period of time to get this done.

[StefanKarpinski]

@mictadlo: if you're interested in getting more familiar with Julia, implementing some of these benchmarks would be an excellent way to start. Another issue is that it may be fairly difficult to convince the shootout to include Julia.

[ViralBShah]

This is good idea, but clearly needs to be a community effort as is pointed out. @mictadlo would you like to anchor this - post to the mailing list, and maybe start on a couple? These can live in our performance tests repository, and once complete, we can see if the guys at alioth add them. I think they will if we can have a debian package by then. All in all, will take a while, but let's get started.

[dcjones]

To get you started, here's the "fasta" benchmark, which I had implemented to get to know Julia: https://gist.github.com/2288846

This one is informative because the performance is a bit lagging. (It's slower than the python program, for example.) There are a lot of operations on strings, which makes me thing it's related to #661.

[ViralBShah]

Excellent! Can you create a pull request and add it to examples?

-viral

On 03-Apr-2012, at 7:58 AM, Daniel Jones wrote:

To get you started, here's the "fasta" benchmark, which I had implemented to get to know Julia: https://gist.github.com/2288846

This one is informative because the performance is a bit lagging. (It's slower than the python program, for example.) There are a lot of operations on strings, which makes me thing it's related to #661.

---

Reply to this email directly or view it on GitHub:
#660 (comment)

[ViralBShah]

Also, I think we should have a new issue open to track this specific performance issue.

-viral

On 03-Apr-2012, at 7:58 AM, Daniel Jones wrote:

To get you started, here's the "fasta" benchmark, which I had implemented to get to know Julia: https://gist.github.com/2288846

This one is informative because the performance is a bit lagging. (It's slower than the python program, for example.) There are a lot of operations on strings, which makes me thing it's related to #661.

---

Reply to this email directly or view it on GitHub:
#660 (comment)

[mictadlo]

dcjones code looks nicer than Rust code https://github.com/mozilla/rust/blob/master/src/test/bench/shootout-fasta.rs

[mictadlo]

• how fast is Julia's RegEx compare to http://lh3lh3.users.sourceforge.net/reb.shtml ?
• How is Julia's hash/dict memory and speed efficient compare to http://lh3lh3.users.sourceforge.net/udb.shtml?

[JeffBezanson]

The global rng_state will be a problem. Are we not allowed to use the usual rand() for this? If not, putting a declaration on uses of that global might fix it completely.

[markhend]

rand() - no
They call out the required random generator at the bottom of the page.

[dcampbell24]

The chameneous-redux and thread-ring benchmarks both require using pre-emptive threads, but I do not see any documentation about using pre-emptive threads in Julia. How should I do these? Use C calls to pthreads? I could also implement versions using tasks that may be considered "interesting alternatives" and might help serve to tell us how well tasks are working. Let me know, thanks.

[quinnj]

So I took a stab at improving the spectral-norm implementation and I think it's significant improvement (293s -> 10-12s).
I'd like to get some other eyeballs on this though to see if there's anything non-idiomatic or other tweaks to improve before doing a pull request.

https://gist.github.com/karbarcca/5340631

[pao]

@karbarcca Please do go ahead and make it a pull request; that makes it easiest to review. Use "RFC:" at the beginning of the pull request title if you are looking for feedback.

[timholy]

That's a nice improvement!

[quinnj]

The last two benchmarks require use of pre-emptive threads (chameneos-redux and thread-ring), which Julia, AFAIK, doesn't officially support, so we can probably close this issue.

chameneos: http://benchmarksgame.alioth.debian.org/u32/performance.php?test=chameneosredux#about
thread-ring: http://benchmarksgame.alioth.debian.org/u32/performance.php?test=threadring

[ViralBShah]

Should we continue having these in base, and integrate them in our rudimentary perf framework, or move them into a separate package - as a first step towards encouraging more benchmarks to be written in julia?

[quinnj]

There seems to be quite a few "code example" repos of various kinds; I wonder if it would make sense to consolidate into a single "Code-Examples" package. A few candidates:

• The shootout benchmarks
• The homepage benchmarks
• julia-tutorial repo under JuliaLang
• The examples folder in the julia repo
• The Rosetta-Code repo I created (we're above 70 tasks now)
• Possibly even the RDatasets.jl package (I think the majority of R tutorials/examples I see reference one of these datasets)

This is quite a lot when listing it all out. We should probably do some organizing/trimming. Maybe have a few categories like Popular Benchmarks (focus on performance), Popular Algorithms, and Common Tasks
We would probably want a standard of sorts in terms of how the code is formatted (generous commenting? expected results in comments or assertions?). The tutorials should probably be farmed out to the various packages or take chunks and fit them into the categories I mentioned above. I think we can also advertise the Manual in this case too since it has a very "tutorial" feel about it with plenty of examples.

[ViralBShah]

They all serve different purposes. Package tags would help address this considerably.