Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[v6r20] Mostly documentation #3675

Merged
merged 17 commits into from
May 15, 2018
Merged

Conversation

fstagni
Copy link
Contributor

@fstagni fstagni commented Apr 26, 2018

BEGINRELEASENOTES

*docs
CHANGE: updated documentation on basic installation and pilots 3

ENDRELEASENOTES

@fstagni fstagni requested review from atsareg and chaen as code owners April 26, 2018 16:32
@@ -9,6 +9,7 @@
import errno
import threading
import sys
from functools import reduce
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a buggy import that keeps coming but I don't know why. probably someone has autopep8 configured for python3

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In this PR it was simply moved (it was few lines below), is it incorrect?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Well, not incorrect per se, but rather useless now :-)
https://docs.python.org/2/library/functools.html#functools.reduce

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see. I leave it here anyway.

@coveralls
Copy link

coveralls commented Apr 26, 2018

Coverage Status

Coverage decreased (-0.007%) to 20.446% when pulling 157954b on fstagni:v6r20-fixes23 into 129f4ab on DIRACGrid:integration.

atsareg
atsareg previously approved these changes Apr 27, 2018
@fstagni
Copy link
Contributor Author

fstagni commented May 15, 2018

Review, please

@@ -136,7 +136,7 @@ def getSiteMask(self, printOutput=False, status='Active'):
return result

#############################################################################
def getBannedSites(self, gridType=[], printOutput=False):
def getBannedSites(self, printOutput=False):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That's a change in the external API, if one wanted to be really strict, we should change major version number

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's anyway unused...


for seName in ses['Value']:
# Ugly, ugly, ugly..
if ('-' not in seName) or ('_' in seName):
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what is that for ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This snippet I copy-pasted from LHCbDIRAC, and I didn't write the original. I believe this was here for excluding the "SandboxSE" or "LogSE" and so on. But indeed this check doesn't make sense anymore, I will remove it.

The components don't need to be all resident on the same host, in fact it's common practice to have several hosts
for large installations.

As a general rul, services can be duplicated,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rul -> rule

Same can be said for executors: you can have many residing on different hosts.

The same can't be said for agents. Some of them can be duplicated, BUT require a proper configuration,
and for this you need to read further in the guide.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You may want to link the scalability page ?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Which one?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Starting Pilots3 via SiteDirectors
==================================

Since DIRAC v6r20, SiteDirectors can send "pilots2" or "pilots3". Pilots2 are the default,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you can use .. versionadded:: v6r20

Copy link
Contributor

@andresailer andresailer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I turned off the whitespace changes, so I hope there is no bug there...

@@ -5,23 +5,29 @@

"""

__RCSID__ = '$Id:$'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

__RCSID__ = '$Id$'


ses = CSHelpers.getStorageElements()
if not ses['OK']:
gLogger.error(ses['Message'])
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

you need to return here, or something, otherwise the next line (ses['Value']) gives an exception

The components don't need to be all resident on the same host, in fact it's common practice to have several hosts
for large installations.

As a general rul, services can be duplicated,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

rule


As a general rul, services can be duplicated,
meaning you can have the same service running on multiple hosts, thus reducing the load.
There are only 2 cases of DIRAC services that have a "master/slave" concept, and these are the Configuration Service
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also the Matcher cannot work more than once I believe.

"""
DIRAC.Core.Utilities package
"""
__RCSID__ = "$Id$"
from DIRAC.Core.Utilities.File import makeGuid, checkGuid, getSize, getGlobbedTotalSize, getGlobbedFiles, getCommonPath, getMD5ForFiles
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might give problems for extensions and should be noted in the transition guide, I think.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

clearly yes, I missed that one !

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Right, updated it. Thanks a lot.

fstagni added 3 commits May 15, 2018 12:01
* upstream/integration:
  Docs: autoformat MakeDoc.py
  Docs: dms doc
  correct the document
  Docs: add developper doc for SE and FC
  DOC: generate documentation for __init__ as well
  Doc: more DMS doc
  improve the documentation
@fstagni
Copy link
Contributor Author

fstagni commented May 15, 2018

DIRACGrid/WebAppDIRAC#291 is needed together with this PR

return S_OK( reason )
return S_OK(reason)

types_getSpaceTokenOccupancy = [(basestring, NoneType, list), (basestring, NoneType, list)]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you need to change this one to types_getFreeDiskSpace

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, fixed that and one more thing.

fstagni added 2 commits May 15, 2018 14:43
…ixes23

* 'v6r20-fixes23' of github.com:fstagni/DIRAC:
  Correct change certificate DNs
  correct typos
  add Accounting documentation
  correct the script options
@atsareg atsareg merged commit 7fe56b1 into DIRACGrid:integration May 15, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants