[SPARK-13481] Desc order of appID by default for history server page.

[zhuoliu]

What changes were proposed in this pull request?

Now by default, it shows as ascending order of appId. We might prefer to display as descending order by default, which will show the latest application at the top.

How was this patch tested?

Manual tested. See screenshot below:

[srowen]

Jenkins, test this please

[srowen]

Descending by app ID != most recent first, right? I could see an argument for the latter but I'm not sure that's what this does. In your example, you even see it shows "local" apps first.

[SparkQA]

Test build #51965 has finished for PR 11357 at commit dfe86bc.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[tgravescs]

descending puts all the applications with application_ in the order with most recent on top. Since its still sorting alphabetically it puts the local- before the application_. I think this is better then ascending where the least recent is on top.

The only other thing we could do is change it to sort numeric and special handle local- vs application_.
Or sort by date by default.

In our case I wouldn't normally expect to see both the local- and application_ in the same history server.

[tgravescs]

+1 on this. @srowen let me know if you have concerns still or if we didn't describe well enough.

[srowen]

Could we just sort by start time? that sounds like the goal.

[tgravescs]

So we could. I was hoping for it to be similar to the YARN RM ui where it sorted by app id. To me its also most intuitive to have first column sorted.

The time isn't necessarily the same as appid order because the application first requests id before ever submitting it. So sorting by time could end up with app ids out of order if one takes longer to actually submit and start.

[zhuoliu]

This basically provides a default view of sorting when the page is loaded. User can easily sort by start time or other columns by clicking the column name.

[tgravescs]

since this is just changing the default order to descending I'm going to check this in, if we want to change which column its sorted by lets file a separate jira.

[srowen]

I don't mind the change if @zhuoliu doesn't since the original idea was to sort by start time. Meh, maybe the JIRA title could be updated but not a big deal.

[zjffdu]

agree with sorting on start time. different mode has different format of app_id. sorting by start time is more reasonable.

[tgravescs]

fyi https://issues.apache.org/jira/browse/SPARK-13775 to sort by completed time.