A sandbox for difference imaging

starting point : redo at lyon + Michael laptop the image difference test

have lsstsw + obs_lsstsim (see cookbook)

• Installation at Lyon:
• setups (to be done for each new session)
  • export LSSTSW=/sps/lsst/Library/new/lsstsw
  • export EUPS_PATH=$LSSTSW/stack
  • source $LSSTSW/bin/setup.sh
  • export PATH=/opt/rh/devtoolset-3/root/usr/bin:${PATH}
• get and compile obs_lsstSim (do this only once ... in theory...)
  • git clone https://github.com/lsst/obs_lsstSim.git
  • cd obs_lsstSim
  • git checkout tickets/DM-4302
  • setup -k -r .
  • scons opt=3
  • cd ..
• setup obs_lsstSim
  • setup -k -r obs_lsstSim
• setup -m none -r and_files astrometry_net_data

get images from cookbook + astrometry (gri_dat_tar.gz) + processed

• data are copied on /sps/lsst/data/twinkles
• to copy the .tar file directly from the https address on a file "name"
  • curl "address" "name"
• processEimage.py input_data/ --id visit=840..841 --output output_data

get images from twinkles

• The Twinkles Run1 processed images are available through 2 mechanisms:

  1. NERSC in
     /global/homes/t/tony_j/Twinkles/985visits
  2. On SLAC machines at
     /nfs/farm/g/lsst/u1/users/tonyj/Twinkles/run1/985visits/

• The PhoSim image are available through the

  1. SLAC Data Catalog
     http://srs.slac.stanford.edu/DataCatalog/?folder=14603345
     Click through LSST-DESC->Twinkles->Twinkles-phoSimII->singleVisit

  put both e-images in images/ and eimages in eimages/, add mapper :

then run

ingestImages.py images/ images/*.fits eimages/*.fits --mode link --output input_data_tw

processEimage.py input_data_tw/ --id visit=490132..495735 --output output_data_tw

Accounts are required from options #2 and #3

run image difference on Simon's cookbook images

$PIPE_TASKS_DIR/bin/imageDifferenceWinter2013.py output_data --id visit=840 filter=r raft=2,2 sensor=1,1 --templateId visit=840 --clobber-config

run image difference on twinkles images

$PIPE_TASKS_DIR/bin/imageDifferenceWinter2013.py output_data_tw --id visit=490132 filter=r raft=2,2 sensor=1,1 --templateId visit=495735 --clobber-config

run twinkles with other configuration