Skip to content

Arbitrary summary HTML #2138

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
143 commits
Select commit Hold shift + click to select a range
3601c29
fix #1505
antgonza Jan 2, 2017
0d6788e
improving some GUI stuff
antgonza Jan 3, 2017
12406cc
improving some GUI stuff - missing lines
antgonza Jan 3, 2017
958fcbe
pull upstream master
antgonza Jan 4, 2017
a57ef23
addressing all comments
antgonza Jan 5, 2017
2ead7a6
ready for review
antgonza Jan 5, 2017
73a78e7
fix #1987
antgonza Jan 16, 2017
e64a22a
Merge pull request #2036 from antgonza/fix-1505
josenavas Jan 16, 2017
0dcae8b
Merge pull request #2047 from antgonza/fix-1987
josenavas Jan 17, 2017
4a5bbbc
initial commit
antgonza Jan 18, 2017
f99975c
requested changes
antgonza Jan 18, 2017
ed899a8
Merge pull request #2049 from antgonza/add-processing-suggestions
josenavas Jan 18, 2017
d508320
fix filter job list
antgonza Jan 18, 2017
025cc1e
Merge pull request #2050 from antgonza/fix-filter-job-list
josenavas Jan 18, 2017
599bcde
Fixing server cert (#2051)
josenavas Jan 19, 2017
d12ccfe
fix get_studies
antgonza Jan 20, 2017
b33983b
flake8
antgonza Jan 20, 2017
b4f1b1f
fix #503
antgonza Jan 20, 2017
62a1b93
fix #2010
antgonza Jan 20, 2017
2e36141
fix #1913
antgonza Jan 21, 2017
e006e20
fix errors
antgonza Jan 21, 2017
c174693
Merge pull request #2052 from antgonza/fix-get_studies
josenavas Jan 23, 2017
131dd6a
Merge pull request #2053 from antgonza/fix-by-blinking
josenavas Jan 23, 2017
ccb55bd
addressing @josenavas comment
antgonza Jan 24, 2017
dfe2e83
flake8
antgonza Jan 24, 2017
15fcceb
Merge pull request #2056 from antgonza/fix-1913
josenavas Jan 24, 2017
7f97f2a
fix #1010
antgonza Jan 26, 2017
9eb9dbb
fix #1066 (#2058)
antgonza Jan 26, 2017
23104d7
addressing @josenavas comments
antgonza Jan 27, 2017
1f1e826
fix #1961
antgonza Jan 27, 2017
19a9dda
fix #1837
antgonza Jan 27, 2017
19889f9
Automatic jobs & new stats (#2057)
antgonza Jan 27, 2017
4e380e0
Merge pull request #2060 from antgonza/fix-1961
wasade Jan 28, 2017
6f0dd71
generalizing this functionality
antgonza Jan 28, 2017
ed9fc65
fix #1816
antgonza Jan 29, 2017
4b19b45
fix #1959
antgonza Jan 30, 2017
d9b41e8
addressing @josenavas comments
antgonza Feb 1, 2017
5ef06ae
addressing @josenavas comments
antgonza Feb 2, 2017
5e3504a
fixing error
antgonza Feb 2, 2017
d10096a
Merge branch 'master' of https://github.com/biocore/qiita into fix-1010
antgonza Feb 2, 2017
661342f
fixed?
antgonza Feb 2, 2017
fcd249b
addressing @josenavas comments
antgonza Feb 3, 2017
f3c1216
Merge pull request #2063 from antgonza/fix-1816
josenavas Feb 3, 2017
a91a6fd
Merge pull request #2064 from antgonza/fix-1959
tanaes Feb 3, 2017
7b9fa6f
addressing @wasade comments
antgonza Feb 3, 2017
33bcbe5
Merge pull request #2059 from antgonza/fix-1010
josenavas Feb 3, 2017
5e4bd9b
Merge branch 'master' of https://github.com/biocore/qiita into fix-1837
antgonza Feb 3, 2017
8bf3d6e
fix flake8
antgonza Feb 3, 2017
7807bac
Merge pull request #2061 from antgonza/fix-1837
josenavas Feb 3, 2017
6360675
generate biom and metadata release (#2066)
antgonza Feb 3, 2017
811b7a7
database changes to fix 969
antgonza Feb 3, 2017
751d4ad
adding delete
antgonza Feb 3, 2017
65a86df
addressing @josenavas comments
antgonza Feb 3, 2017
b1817dd
addressing @ElDeveloper comments
antgonza Feb 4, 2017
18d77e1
duh!
antgonza Feb 4, 2017
01c656c
Merge pull request #2071 from antgonza/fix-969-db
josenavas Feb 6, 2017
53188a6
fix generate_biom_and_metadata_release (#2072)
antgonza Feb 7, 2017
1ab4e3b
Fixing merge conflicts with master
josenavas Feb 8, 2017
1e8332e
Merge branch 'analysis-refactor' of https://github.com/biocore/qiita …
josenavas Feb 9, 2017
cb67d3d
Removing qiita ware code that will not be used anymore
josenavas Feb 9, 2017
5a5127d
Merge branch 'analysis-refactor' of https://github.com/biocore/qiita …
josenavas Feb 9, 2017
0033480
Organizing the handlers and new analysis description page
josenavas Feb 9, 2017
3e3f6e1
fixing timestamp
antgonza Feb 9, 2017
6a20c1b
rm formats
antgonza Feb 9, 2017
a1b3c90
st -> pt
antgonza Feb 9, 2017
3809ad5
Connecting the analysis creation and making interface responsive
josenavas Feb 9, 2017
067f14f
Addressing @antgonza's comments
josenavas Feb 10, 2017
cf4862d
Solving merge conflicts
josenavas Feb 10, 2017
3b07151
Initial artifact GUI refactor
josenavas Feb 10, 2017
a6595a9
Removing unused code
josenavas Feb 10, 2017
6343b49
Merge branch 'analysis-refactor-gui-part2' into analysis-refactor-gui…
josenavas Feb 10, 2017
a3505c2
moving to ISO 8601 - wow :'(
antgonza Feb 13, 2017
c8113ea
fix errors
antgonza Feb 13, 2017
f4835d5
addressing @wasade comments
antgonza Feb 13, 2017
f731768
Adding can_edit call to the analysis
josenavas Feb 14, 2017
7542658
Fixing artifact rest API since not all artifacts have study
josenavas Feb 14, 2017
e0180e8
Adding can_be_publicized call to analysis
josenavas Feb 15, 2017
f55ca5c
Adding QiitaHTTPError to handle errors gracefully
josenavas Feb 15, 2017
1fa4b19
Adding safe_execution contextmanager
josenavas Feb 15, 2017
b61ae87
Fixing typo
josenavas Feb 15, 2017
bb68303
Adding qiita test checker
josenavas Feb 15, 2017
b31a025
Adapting some artifact handlers
josenavas Feb 15, 2017
378d7ff
Fixing merge conflicts
josenavas Feb 15, 2017
444da08
Merge branch 'analysis-refactor-gui-part2' into analysis-refactor-gui…
josenavas Feb 15, 2017
f6b4c46
Abstracting the graph reloading and adding some documentation
josenavas Feb 15, 2017
e9d3af3
Fixing typo
josenavas Feb 15, 2017
69b6412
Merge branch 'analysis-refactor-gui-part3' into analysis-refactor-gui…
josenavas Feb 15, 2017
60cd430
Fixing changing artifact visibility
josenavas Feb 15, 2017
be099cb
Fixing delete
josenavas Feb 15, 2017
819e9a5
Fixing artifact deletion
josenavas Feb 15, 2017
e941fa7
Adding default parameters to the commands
josenavas Feb 15, 2017
d6ebcb4
Fixing processing page
josenavas Feb 15, 2017
6ada2ba
Fixing variable name
josenavas Feb 15, 2017
7d70a38
fixing private/public studies
antgonza Feb 15, 2017
e8ca9db
Changing bdiv metrics to single choice
josenavas Feb 15, 2017
4bf4808
Merge pull request #2080 from antgonza/fix-private_public-stats-page
josenavas Feb 15, 2017
aa68a21
Merge pull request #2075 from antgonza/fix-timestamp
wasade Feb 15, 2017
0c6ffa7
sanbox-to-sandbox
antgonza Feb 15, 2017
586660b
flake8
antgonza Feb 15, 2017
6cdc574
Fixing patch
josenavas Feb 15, 2017
7bae13e
fixing other issues
antgonza Feb 16, 2017
cf801a4
Merge pull request #2082 from antgonza/sanbox-to-sandbox
josenavas Feb 16, 2017
7c2454e
adding share documentation
antgonza Mar 3, 2017
c2eb6ae
psycopg2 <= 2.7
antgonza Mar 3, 2017
aeeac62
psycopg2 < 2.7
antgonza Mar 3, 2017
2795046
Merge pull request #2085 from antgonza/sharing-help
josenavas Mar 3, 2017
a77b040
Various small fixes to be able to run tests on the plugins
josenavas Mar 15, 2017
ff9eda9
Merging with master
josenavas Mar 15, 2017
6145976
Adding private module
josenavas Mar 15, 2017
7153efb
Fixing processing job completion
josenavas Mar 15, 2017
46dd73d
Fixing patch 52
josenavas Mar 16, 2017
08eafaa
Fixing call
josenavas Mar 16, 2017
b1a3e99
Fixing complete
josenavas Mar 17, 2017
c9580b7
small fixes
josenavas Mar 17, 2017
85d4aa7
Solving merge conflicts
josenavas Apr 24, 2017
1ffa231
Solving merge conflicts
josenavas Apr 24, 2017
9e14cc6
Merge branch 'analysis-refactor-gui-part5' into analysis-refactor-gui…
josenavas Apr 24, 2017
4cd34d2
Merge branch 'analysis-refactor-gui-part6' into analysis-refactor-gui…
josenavas Apr 24, 2017
bf33527
Solving merge conflicts
josenavas Apr 25, 2017
3529556
Adding processing handlers
josenavas Apr 25, 2017
ca5a331
Fixing url and bug on processing job workflow
josenavas May 1, 2017
b934d68
Adding the private script runner
josenavas May 1, 2017
fa00d60
Adding is_analysis column to the command
josenavas May 1, 2017
b2ac959
Adding retrieval of commands excluding analysis commands
josenavas May 1, 2017
0326a63
Addressing bug on retrieving information from redis
josenavas May 1, 2017
cd6b61c
Enabling the command register endpoint to provide if the command is a…
josenavas May 4, 2017
cccb1d4
Addressing @antgonza's comments
josenavas May 16, 2017
0a584f3
Addressing @wasade's comments
josenavas May 16, 2017
a33d14f
Supporting multiple choice
josenavas May 17, 2017
66986ab
Adding documentation
josenavas May 17, 2017
3e36212
Modifying handler to pass allow_change_optionals
josenavas May 22, 2017
e04d03d
Solving merge conflicts
josenavas May 22, 2017
dc3a51e
returning optional parameters
josenavas May 22, 2017
12235a7
Addressing bug found by @antgonza
josenavas May 22, 2017
f5c5811
Enabling changing the default parameters
josenavas May 22, 2017
08554e1
Adding correct class
josenavas May 22, 2017
04a0c26
Allowing user to change default parameters
josenavas May 24, 2017
4330dae
Fixing bug with commands listing
josenavas May 24, 2017
4afa539
Enabling arbitrary htmls in the summary
josenavas May 31, 2017
3b8acdc
Addressing @wasade's comments
josenavas May 31, 2017
389ea9f
Merge branch 'analysis-refactor-allow-users-change-dflt-params' into …
josenavas May 31, 2017
29b6acf
Merge branch 'analysis-refactor' of https://github.com/biocore/qiita …
josenavas Jun 1, 2017
b35e07c
Addressing @antgonza's comment
josenavas Jun 1, 2017
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions qiita_pet/handlers/artifact_handlers/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,9 @@
# The full license is in the file LICENSE, distributed with this software.
# -----------------------------------------------------------------------------

from .base_handlers import ArtifactSummaryAJAX, ArtifactAJAX
from .base_handlers import (ArtifactSummaryAJAX, ArtifactAJAX,
ArtifactSummaryHandler)
from .process_handlers import ProcessArtifactHandler

__all__ = ['ArtifactSummaryAJAX', 'ArtifactAJAX', 'ProcessArtifactHandler']
__all__ = ['ArtifactSummaryAJAX', 'ArtifactAJAX', 'ArtifactSummaryHandler',
'ProcessArtifactHandler']
33 changes: 29 additions & 4 deletions qiita_pet/handlers/artifact_handlers/base_handlers.py
Original file line number Diff line number Diff line change
Expand Up @@ -6,10 +6,10 @@
# The full license is in the file LICENSE, distributed with this software.
# -----------------------------------------------------------------------------

from os.path import basename
from os.path import basename, relpath
from json import dumps

from tornado.web import authenticated
from tornado.web import authenticated, StaticFileHandler
from moi import r_client

from qiita_core.qiita_settings import qiita_config
Expand Down Expand Up @@ -108,8 +108,12 @@ def artifact_summary_get_request(user, artifact_id):

# Check if the HTML summary exists
if summary:
with open(summary[1]) as f:
summary = f.read()
# Magic number 1: If the artifact has a summary, the call
# artifact.html_summary_fp returns a tuple with 2 elements. The first
# element is the filepath id, while the second one is the actual
# actual filepath. We are only interested on the actual filepath,
# hence the 1 value.
summary = relpath(summary[1], qiita_config.base_data_dir)
else:
# Check if the summary is being generated
command = Command.get_html_generator(artifact.artifact_type)
Expand Down Expand Up @@ -394,3 +398,24 @@ def patch(self, artifact_id):
req_path, req_value, req_from)

self.finish()


class ArtifactSummaryHandler(StaticFileHandler, BaseHandler):
def validate_absolute_path(self, root, absolute_path):
"""Overrides StaticFileHandler's method to include authentication"""
user = self.current_user

# Magic number 1, the path structure for the summaries is
# root/ARTIFACTDIR/artifact_id/FILE. We are interested in the
# artifact_id. root is removed by relpath, so the second element of the
# list is the artifact id
artifact_id = relpath(absolute_path, root).split('/')[1]

# This call will check if the user has access to the artifact or not,
# taking into account admin privileges. If not it will raise a 403
# which will be handled correctly by tornado
check_artifact_access(user, Artifact(artifact_id))

# If we reach this point the user has access to the file - return it
return super(ArtifactSummaryHandler, self).validate_absolute_path(
root, absolute_path)
37 changes: 33 additions & 4 deletions qiita_pet/handlers/artifact_handlers/tests/test_base_handlers.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,11 +9,12 @@
from unittest import TestCase, main
from tempfile import mkstemp
from os import close, remove
from os.path import basename, exists
from os.path import basename, exists, relpath

from tornado.web import HTTPError

from qiita_core.util import qiita_test_checker
from qiita_db.util import get_db_files_base_dir
from qiita_db.user import User
from qiita_db.artifact import Artifact
from qiita_db.processing_job import ProcessingJob
Expand Down Expand Up @@ -134,6 +135,8 @@ def test_artifact_summary_get_request(self):
exp_files.append(
(a.html_summary_fp[0],
'%s (html summary)' % basename(a.html_summary_fp[1])))
exp_summary_path = relpath(
a.html_summary_fp[1], get_db_files_base_dir())
obs = artifact_summary_get_request(user, 1)
exp = {'name': 'Raw data 1',
'artifact_id': 1,
Expand All @@ -150,7 +153,7 @@ def test_artifact_summary_get_request(self):
'sandbox</button>'),
'processing_parameters': {},
'files': exp_files,
'summary': '<b>HTML TEST - not important</b>\n',
'summary': exp_summary_path,
'job': None,
'processing_jobs': exp_p_jobs,
'errored_jobs': []}
Expand All @@ -171,7 +174,7 @@ def test_artifact_summary_get_request(self):
'buttons': '',
'processing_parameters': {},
'files': [],
'summary': '<b>HTML TEST - not important</b>\n',
'summary': exp_summary_path,
'job': None,
'processing_jobs': exp_p_jobs,
'errored_jobs': []}
Expand Down Expand Up @@ -228,7 +231,7 @@ def test_artifact_summary_get_request(self):
'editable': True,
'buttons': '',
'processing_parameters': {},
'files': [(22, 'biom_table.biom (biom)')],
'files': [(27, 'biom_table.biom (biom)')],
'summary': None,
'job': None,
'processing_jobs': [],
Expand Down Expand Up @@ -309,6 +312,16 @@ def test_artifact_patch_request(self):


class TestBaseHandlers(TestHandlerBase):
def setUp(self):
super(TestBaseHandlers, self).setUp()
self._files_to_remove = []

def tearDown(self):
super(TestBaseHandlers, self).tearDown()
for fp in self._files_to_remove:
if exists(fp):
remove(fp)

def test_get_artifact_summary_ajax_handler(self):
response = self.get('/artifact/1/summary/')
self.assertEqual(response.code, 200)
Expand All @@ -322,6 +335,22 @@ def test_patch_artifact_ajax_handler(self):
self.assertEqual(a.name, 'NEW_NAME')
a.name = 'Raw data 1'

def test_get_artifact_summary_handler(self):
a = Artifact(1)
# Add a summary to the artifact
fd, fp = mkstemp(suffix=".html")
close(fd)
with open(fp, 'w') as f:
f.write('<b>HTML TEST - not important</b>\n')
a = Artifact(1)
a.html_summary_fp = fp
self._files_to_remove.extend([fp, a.html_summary_fp[1]])

summary = relpath(a.html_summary_fp[1], get_db_files_base_dir())
response = self.get('/artifact/html_summary/%s' % summary)
self.assertEqual(response.code, 200)
self.assertEqual(response.body, '<b>HTML TEST - not important</b>\n')


if __name__ == '__main__':
main()
2 changes: 1 addition & 1 deletion qiita_pet/templates/artifact_ajax/artifact_summary.html
Original file line number Diff line number Diff line change
Expand Up @@ -144,7 +144,7 @@ <h4>
<div class='row'>
<div class='col-md-12' id='artifact-summary-content'>
{% if summary is not None %}
{% raw summary %}
<iframe width="100%" height="900" src="/artifact/html_summary/{{summary}}" frameBorder=0></iframe>
{% elif job is not None %}
Job <b>{{ job[0] }}</b>: <i>{{ job[1] }}</i> {{ job[2] }}
{% else %}
Expand Down
5 changes: 4 additions & 1 deletion qiita_pet/webserver.py
Original file line number Diff line number Diff line change
Expand Up @@ -34,7 +34,8 @@
PrepTemplateSummaryAJAX,
WorkflowHandler, WorkflowRunHandler, JobAJAX, AutocompleteHandler)
from qiita_pet.handlers.artifact_handlers import (
ArtifactSummaryAJAX, ArtifactAJAX, ProcessArtifactHandler)
ArtifactSummaryAJAX, ArtifactAJAX, ArtifactSummaryHandler,
ProcessArtifactHandler)
from qiita_pet.handlers.websocket_handlers import (
MessageHandler, SelectedSocketHandler, SelectSamplesHandler)
from qiita_pet.handlers.logger_handlers import LogEntryViewerHandler
Expand Down Expand Up @@ -129,6 +130,8 @@ def __init__(self):
# Artifact handlers
(r"/artifact/graph/", ArtifactGraphAJAX),
(r"/artifact/(.*)/summary/", ArtifactSummaryAJAX),
(r"/artifact/html_summary/(.*)", ArtifactSummaryHandler,
{"path": qiita_config.base_data_dir}),
(r"/artifact/(.*)/process/", ProcessArtifactHandler),
(r"/artifact/(.*)/", ArtifactAJAX),
(r"/prep_template/", PrepTemplateHandler),
Expand Down