Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
285 changes: 133 additions & 152 deletions _layouts/global.html

Large diffs are not rendered by default.

185 changes: 185 additions & 0 deletions _layouts/home.html
Original file line number Diff line number Diff line change
@@ -0,0 +1,185 @@
<!doctype html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>
{% if page.custom_title %} {{page.custom_title}}
{% else %} {{page.title}} | Apache Spark
{% endif %}
</title>
{% if page.redirect %}
<meta http-equiv="refresh" content="0; url={{site.baseurl}}/{{page.redirect}}">
<link rel="canonical" href="{{site.url}}{{site.baseurl}}/{{page.redirect}}" />
{% endif %}

{% if page.description %}
<meta name="description" content="{{page.description}}">
{% endif %}

<meta name="twitter:card" content="summary_large_image">
<meta name="twitter:site" content="@ApacheSpark">
<meta name="twitter:title" content="{% if page.custom_title %} {{page.custom_title}}{% else %} {{page.title}} | Apache Spark{% endif %}">
<meta name="twitter:description" content="{% if page.description %}{{page.description}}{% else %}Apache Spark is a unified engine for large-scale analytics{% endif %}">
<meta name="twitter:image" content="{{site.url}}{{site.baseurl}}images/spark-twitter-card-large.jpg">


<link href="https://cdn.jsdelivr.net/npm/bootstrap@5.0.2/dist/css/bootstrap.min.css" rel="stylesheet"
integrity="sha384-EVSTQN3/azprG1Anm3QDgpJLIm9Nao0Yz1ztcQTwFspd3yD65VohhpuuCOmLASjC" crossorigin="anonymous">
<link rel="preconnect" href="https://fonts.googleapis.com">
<link rel="preconnect" href="https://fonts.gstatic.com" crossorigin>
<link href="https://fonts.googleapis.com/css2?family=DM+Sans:ital,wght@0,400;0,500;0,700;1,400;1,500;1,700&Courier+Prime:wght@400;700&display=swap" rel="stylesheet">
<link href="{{site.baseurl}}/css/custom.css" rel="stylesheet">
<link href="{{site.baseurl}}/css/pygments-default.css" rel="stylesheet">
<link rel="icon" href="favicon.ico" type="image/x-icon">

<script type="text/javascript">
<!-- Google Analytics initialization -->
var _gaq = _gaq || [];
_gaq.push(['_setAccount', 'UA-32518208-2']);
_gaq.push(['_trackPageview']);
(function() {
var ga = document.createElement('script'); ga.type = 'text/javascript'; ga.async = true;
ga.src = ('https:' == document.location.protocol ? 'https://ssl' : 'http://www') + '.google-analytics.com/ga.js';
var s = document.getElementsByTagName('script')[0]; s.parentNode.insertBefore(ga, s);
})();

<!-- Adds slight delay to links to allow async reporting -->
function trackOutboundLink(link, category, action) {
try {
_gaq.push(['_trackEvent', category , action]);
} catch(err){}

setTimeout(function() {
document.location.href = link.href;
}, 100);
}
</script>
</head>
<body>
<nav class="navbar navbar-expand-lg navbar-dark p-0 px-4" style="background: #1D6890;">
<a class="navbar-brand" href="/">
<img src="{{site.baseurl}}/images/spark-logo-rev.svg" alt="" width="141" height="72">
</a>
<button class="navbar-toggler" type="button" data-bs-toggle="collapse" data-bs-target="#navbarContent"
aria-controls="navbarContent" aria-expanded="false" aria-label="Toggle navigation">
<span class="navbar-toggler-icon"></span>
</button>
<div class="collapse navbar-collapse col-md-12 col-lg-auto pt-4" id="navbarContent">

<ul class="navbar-nav me-auto">
<li class="nav-item">
<a class="nav-link active" aria-current="page" href="{{site.baseurl}}/downloads.html">Download</a>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="libraries" role="button" data-bs-toggle="dropdown"
aria-expanded="false">
Libraries
</a>
<ul class="dropdown-menu" aria-labelledby="libraries">
<li><a class="dropdown-item" href="{{site.baseurl}}/sql/">SQL and DataFrames</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/streaming/">Spark Streaming</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/mllib/">MLlib (machine learning)</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/graphx/">GraphX (graph)</a></li>
<li>
<hr class="dropdown-divider">
</li>
<li><a class="dropdown-item" href="{{site.baseurl}}/third-party-projects.html">Third-Party Projects</a></li>
</ul>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="documentation" role="button" data-bs-toggle="dropdown"
aria-expanded="false">
Documentation
</a>
<ul class="dropdown-menu" aria-labelledby="documentation">
<li><a class="dropdown-item" href="{{site.baseurl}}/docs/latest/">Latest Release (Spark 3.1.2)</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/documentation.html">Older Versions and Other Resources</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/faq.html">Frequently Asked Questions</a></li>
</ul>
</li>
<li class="nav-item">
<a class="nav-link active" aria-current="page" href="{{site.baseurl}}/examples.html">Examples</a>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="community" role="button" data-bs-toggle="dropdown"
aria-expanded="false">
Community
</a>
<ul class="dropdown-menu" aria-labelledby="community">
<li><a class="dropdown-item" href="{{site.baseurl}}/community.html">Mailing Lists &amp; Resources</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/contributing.html">Contributing to Spark</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/improvement-proposals.html">Improvement Proposals (SPIP)</a>
</li>
<li><a class="dropdown-item" href="https://issues.apache.org/jira/browse/SPARK">Issue Tracker</a>
</li>
<li><a class="dropdown-item" href="{{site.baseurl}}/powered-by.html">Powered By</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/committers.html">Project Committers</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/history.html">Project History</a></li>
</ul>
</li>
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="developers" role="button" data-bs-toggle="dropdown"
aria-expanded="false">
Developers
</a>
<ul class="dropdown-menu" aria-labelledby="developers">
<li><a class="dropdown-item" href="{{site.baseurl}}/developer-tools.html">Useful Developer Tools</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/versioning-policy.html">Versioning Policy</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/release-process.html">Release Process</a></li>
<li><a class="dropdown-item" href="{{site.baseurl}}/security.html">Security</a></li>
</ul>
</li>
</ul>
<ul class="navbar-nav ml-auto">
<li class="nav-item dropdown">
<a class="nav-link dropdown-toggle" href="#" id="apacheFoundation" role="button"
data-bs-toggle="dropdown" aria-expanded="false">
Apache Software Foundation
</a>
<ul class="dropdown-menu" aria-labelledby="apacheFoundation">
<li><a class="dropdown-item" href="https://www.apache.org/">Apache Homepage</a></li>
<li><a class="dropdown-item" href="https://www.apache.org/licenses/">License</a></li>
<li><a class="dropdown-item"
href="https://www.apache.org/foundation/sponsorship.html">Sponsorship</a></li>
<li><a class="dropdown-item" href="https://www.apache.org/foundation/thanks.html">Thanks</a></li>
<li><a class="dropdown-item" href="https://www.apache.org/security/">Security</a></li>
</ul>
</li>
</ul>
</div>
</nav>
<section class="hero-banner position-relative">
<div class="bg"></div>
<div class="container position-relative">
<div class="container pt-5 pb-5">
<div class="row">
<div class="col-12 col-md-12 col-lg-7">
<h1 style="max-width: 680px;">Unified engine for large-scale data analytics</h1>
<a href="{{site.baseurl}}/docs/latest/quick-start.html" class="btn btn-cta">Get Started</a>
</div>
</div>
<div class="row mt-5">
<div class="col-12 col-lg-6">
<h2>What is Apache Spark<span class="tm" style="bottom: 14px;">&trade;</span>?</h2>
<div class="what-is-spark">Apache Spark<span class="tm" style="bottom: 7px;">&trade;</span> is a multi-language engine for executing data engineering,
data science, and machine learning on single-node machines or clusters.
</div>
</div>
</div>
</div>
</div>
</section>

{{content}}

<footer class="container row mx-auto">
<hr>
Apache Spark, Spark, Apache, the Apache feather logo, and the Apache Spark project logo are either registered trademarks or trademarks of The Apache Software Foundation in the United States and other countries. See guidance on use of Apache Spark <a href="/trademarks.html">trademarks</a>. All other marks mentioned may be trademarks or registered trademarks of their respective owners. Copyright © 2018 The Apache Software Foundation, Licensed under the <a href="https://www.apache.org/licenses/">Apache License, Version 2.0</a>.
</footer>
<script src="https://cdn.jsdelivr.net/npm/bootstrap@5.0.2/dist/js/bootstrap.bundle.min.js"
integrity="sha384-MrcW6ZMFYlzcLA8Nl+NtUVF0sA7MsXsP1UyJoMp4YLEuNSfAP+JcXn/tWtIaxVXM"
crossorigin="anonymous"></script>
</body>
</html>
Binary file added apple-touch-icon.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
14 changes: 7 additions & 7 deletions committers.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ navigation:
weight: 5
show: true
---
<h2>Current Committers</h2>
<h2>Current committers</h2>

|Name|Organization|
|----|------------|
Expand Down Expand Up @@ -94,7 +94,7 @@ navigation:
|Ruifeng Zheng|JD.com|
|Shixiong Zhu|Databricks|

<h3>Becoming a Committer</h3>
<h3>Becoming a committer</h3>

To get started contributing to Spark, learn
<a href="{{site.baseurl}}/contributing.html">how to contribute</a> –
Expand Down Expand Up @@ -130,7 +130,7 @@ helping vote on releases, enforce Apache project trademarks, take responsibility
and ensure the project follows Apache project mechanics. The PMC periodically adds committers to the PMC
who have shown they understand and can help with these activities.

<h3>Review Process</h3>
<h3>Review process</h3>

All contributions should be reviewed before merging as described in
<a href="{{site.baseurl}}/contributing.html">Contributing to Spark</a>.
Expand Down Expand Up @@ -159,12 +159,12 @@ Being a committer means exercising your judgement while working in a community o

It is hoped that these guidelines do not slow down development; rather, by removing some of the uncertainty, the goal is to make it easier for us to reach consensus. If you have ideas on how to improve these guidelines or other Spark project operating procedures, you should reach out on the dev@ list to start the discussion.

<h3>How to Merge a Pull Request</h3>
<h3>How to merge a pull request</h3>

Changes pushed to the master branch on Apache cannot be removed; that is, we can't force-push to
it. So please don't add any test commits or anything like that, only real patches.

<h4>Setting up Remotes</h4>
<h4>Setting up remotes</h4>

To use the `merge_spark_pr.py` script described below, you
will need to add a git remote called `apache` at `https://github.com/apache/spark`,
Expand Down Expand Up @@ -197,7 +197,7 @@ To check whether the necessary write access are already granted please visit [Gi

Ask `dev@spark.apache.org` if you have trouble with these steps, or want help doing your first merge.

<h4>Merge Script</h4>
<h4>Merge script</h4>

All merges should be done using the
[dev/merge_spark_pr.py](https://github.com/apache/spark/blob/master/dev/merge_spark_pr.py),
Expand All @@ -219,7 +219,7 @@ https://issues.apache.org/jira/plugins/servlet/project-config/SPARK/roles .

Once a PR is merged please leave a comment on the PR stating which branch(es) it has been merged with.

<h3>Policy on Backporting Bug Fixes</h3>
<h3>Policy on backporting bug fixes</h3>

From <a href="https://www.mail-archive.com/dev@spark.apache.org/msg10284.html">`pwendell`</a>:

Expand Down
16 changes: 8 additions & 8 deletions community.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,10 +7,10 @@ navigation:
show: true
---

<h2>Apache Spark Community</h2>
<h2>Apache Spark<span class="tm">&trade;</span> community</h2>

<a name="have-questions"></a>
<h3>Have Questions?</h3>
<h3>Have questions?</h3>

<h4>StackOverflow</h4>

Expand All @@ -35,7 +35,7 @@ Some quick tips when using StackOverflow:
- No jobs, sales, or solicitation is permitted on StackOverflow

<a name="mailing-lists"></a>
<h4>Mailing Lists</h4>
<h4>Mailing lists</h4>

For broad, opinion based, ask for external resources, debug issues, bugs, contributing to the
project, and scenarios, it is recommended you use the user@spark.apache.org mailing list.
Expand Down Expand Up @@ -72,13 +72,13 @@ Some quick tips when using email:
and include only a few lines of the pertinent code / log within the email.
- No jobs, sales, or solicitation is permitted on the Apache Spark mailing lists.

<h5>Reporting Security Issues</h5>
<h5>Reporting security issues</h5>

Please see the [Security](security.html) page for information on how to report sensitive security
vulnerabilities, and for information on known security issues.

<a name="chat"></a>
<h4>Chat Rooms</h4>
<h4>Chat rooms</h4>

Chat rooms are great for quick questions or discussions on specialized topics. The following chat rooms are not officially part of Apache Spark; they are provided for reference only.
<ul>
Expand All @@ -88,7 +88,7 @@ Chat rooms are great for quick questions or discussions on specialized topics. T
</ul>

<a name="events"></a>
<h3>Events and Meetups</h3>
<h3>Events and meetups</h3>

<h4>Conferences</h4>
<ul>
Expand Down Expand Up @@ -197,11 +197,11 @@ Spark Meetups are grass-roots events organized and hosted by individuals in the
<p>If you'd like your meetup or conference added, please email <a href="mailto:user@spark.apache.org">user@spark.apache.org</a>.</p>

<a name="issue-tracker"></a>
<h3>Issue Tracker</h3>
<h3>Issue tracker</h3>

<p>The project tracks bugs and new features on <a href="https://issues.apache.org/jira/browse/SPARK">JIRA</a>. If you'd like, you can also subscribe to <a href="https://mail-archives.apache.org/mod_mbox/spark-issues/">issues@spark.apache.org</a> to receive emails about new issues, and <a href="https://mail-archives.apache.org/mod_mbox/spark-commits/">commits@spark.apache.org</a> to get emails about commits.</p>

<h3>Powered By</h3>
<h3>Powered by</h3>

<p>Our site has a list of <a href="{{site.baseurl}}/powered-by.html">projects and organizations powered by Spark</a>.
Add yours by emailing `dev@spark.apache.org`.
Expand Down
Loading