Upgrade to 6.0.0 fails #6330

wolkenschieber · 2013-12-11T21:21:13Z

Another update, another failure with postgres :-(

I just upgraded from 5.0.0.14 to 6.0.0. Maintance mode can't be left, because database schema upgrade doesn't finish.

Postgres.log:
ERROR: syntax error at end of input at character 60
STATEMENT: ALTER TABLE "oc_pictures_images_cache" ALTER uid_owner SET

owncloud.log:
{"app":"core","message":"Failed to update database structure (exception 'PDOException' with message 'SQLSTATE[42601]: Syntax error: 7 ERROR: synt
ax error at end of input\nLINE 1: ALTER TABLE "oc_pictures_images_cache" ALTER uid_owner SET \n
^' in /var/www/owncloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php:742\nStack trace:\n#0 [internal functi
on]: PDO->query('ALTER TABLE "oc...')\n#1 /var/www/owncloud/3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Connection.php(742): call_user_func_array(Array, Array)\n#2 /var/www/owncloud/lib/private/db/mdb2schemamanager.php(152):

karlitschek · 2013-12-11T21:34:56Z

duplicate of #6313

wolkenschieber · 2013-12-11T21:37:42Z

A quick fix for me was to drop the tables oc_pictures_images_cache and oc_gallery_sharing.

wolkenschieber · 2013-12-11T21:43:47Z

There's obviously a bug in the database scheme upgrade process.

MorrisJobke · 2013-12-11T21:49:42Z

@bartv2 Can you have a look?

MorrisJobke · 2013-12-11T21:50:29Z

The message looks like an incomplete SQL statement.
https://github.com/owncloud/apps/blob/master/gallery/appinfo/database.xml

butonic · 2013-12-11T22:47:57Z

could reproduce the issue with installing a stock OC5 on postgres, uploading a few files, ant then doing the migrate to OC6. Had defined DEBUG as true:

{"app":"index","message":"Exception: An exception occurred while executing 'SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = ? AND \"argument\" = ?':\n\nSQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 0 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/Statement.php(140): Doctrine\\DBAL\\DBALException::driverExceptionDuringQuery(Object(PDOException), 'SELECT \"id\" FRO...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 1 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/statementwrapper.php(70): Doctrine\\DBAL\\Statement->execute(Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 2 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/backgroundjob\/joblist.php(71): OC_DB_StatementWrapper->execute(Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 3 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/backgroundjob\/joblist.php(24): OC\\BackgroundJob\\JobList->has('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 4 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/public\/backgroundjob.php(75): OC\\BackgroundJob\\JobList->add('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 5 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/public\/backgroundjob.php(86): OCP\\BackgroundJob::registerJob('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 6 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/apps\/files\/appinfo\/app.php(22): OCP\\BackgroundJob::addRegularTask('\\OC\\Files\\Cache...', 'checkNext')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 7 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/app.php(93): require_once('\/home\/jfd\/Repos...')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 8 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/app.php(66): OC_App::loadApp('files')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 9 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/base.php(689): OC_App::loadApps()\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 10 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/index.php(30): OC::handleRequest()\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 11 {main}","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: An exception occurred while executing 'SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = ? AND \"argument\" = ?':\n\nSQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^ - Verursacht durch: SQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^[42P01] ","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"core","message":"Failed to update database structure (exception 'PDOException' with message 'SQLSTATE[42601]: Syntax error: 7 FEHLER:  Syntaxfehler am Ende der Eingabe\nLINE 1: ALTER TABLE \"oc_properties\" ALTER propertyvalue SET \n                                                            ^' in \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/Connection.php:742\nStack trace:\n#0 [internal function]: PDO->query('ALTER TABLE \"oc...')\n#1 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/Connection.php(742): call_user_func_array(Array, Array)\n#2 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/mdb2schemamanager.php(152): Doctrine\\DBAL\\Connection->query('ALTER TABLE \"oc...')\n#3 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/mdb2schemamanager.php(91): OC\\DB\\MDB2SchemaManager->executeSchemaChange(Object(Doctrine\\DBAL\\Schema\\SchemaDiff))\n#4 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db.php(373): OC\\DB\\MDB2SchemaManager->updateDbFromStructure('\/home\/jfd\/Repos...')\n#5 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/updater.php(106): OC_DB::updateDbFromStructure('\/home\/jfd\/Repos...')\n#6 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/core\/ajax\/update.php(34): OC\\Updater->upgrade()\n#7 {main}\n\nNext exception 'Doctrine\\DBAL\\DBALException' with message 'An exception occurred while executing 'ALTER TABLE \"oc_properties\" ALTER propertyvalue SET ':\n\nSQLSTATE[42601]: Syntax error: 7 FEHLER:  Syntaxfehler am Ende der Eingabe\nLINE 1: ALTER TABLE \"oc_properties\" ALTER propertyvalue SET \n                                                            ^' in \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/DBALException.php:47\nStack trace:\n#0 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/Connection.php(744): Doctrine\\DBAL\\DBALException::driverExceptionDuringQuery(Object(PDOException), 'ALTER TABLE \"oc...')\n#1 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/mdb2schemamanager.php(152): Doctrine\\DBAL\\Connection->query('ALTER TABLE \"oc...')\n#2 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/mdb2schemamanager.php(91): OC\\DB\\MDB2SchemaManager->executeSchemaChange(Object(Doctrine\\DBAL\\Schema\\SchemaDiff))\n#3 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db.php(373): OC\\DB\\MDB2SchemaManager->updateDbFromStructure('\/home\/jfd\/Repos...')\n#4 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/updater.php(106): OC_DB::updateDbFromStructure('\/home\/jfd\/Repos...')\n#5 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/core\/ajax\/update.php(34): OC\\Updater->upgrade()\n#6 {main})","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"core","message":"App \"\" (user_migrate) can't be used because it is not compatible with this version of ownCloud","level":3,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: An exception occurred while executing 'SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = ? AND \"argument\" = ?':\n\nSQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 0 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/3rdparty\/doctrine\/dbal\/lib\/Doctrine\/DBAL\/Statement.php(140): Doctrine\\DBAL\\DBALException::driverExceptionDuringQuery(Object(PDOException), 'SELECT \"id\" FRO...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 1 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/db\/statementwrapper.php(70): Doctrine\\DBAL\\Statement->execute(Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 2 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/backgroundjob\/joblist.php(71): OC_DB_StatementWrapper->execute(Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 3 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/backgroundjob\/joblist.php(24): OC\\BackgroundJob\\JobList->has('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 4 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/public\/backgroundjob.php(75): OC\\BackgroundJob\\JobList->add('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 5 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/public\/backgroundjob.php(86): OCP\\BackgroundJob::registerJob('OC\\BackgroundJo...', Array)\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 6 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/apps\/files\/appinfo\/app.php(22): OCP\\BackgroundJob::addRegularTask('\\OC\\Files\\Cache...', 'checkNext')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 7 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/app.php(93): require_once('\/home\/jfd\/Repos...')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 8 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/private\/app.php(66): OC_App::loadApp('files')\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 9 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/lib\/base.php(689): OC_App::loadApps()\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 10 \/home\/jfd\/Repositories\/oc\/owncloud.dist.6.0.0\/index.php(30): OC::handleRequest()\n","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: 11 {main}","level":4,"time":"2013-12-11T22:34:52+00:00"}
{"app":"index","message":"Exception: An exception occurred while executing 'SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = ? AND \"argument\" = ?':\n\nSQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^ - Verursacht durch: SQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^[42P01] ","level":4,"time":"2013-12-11T22:34:52+00:00"}

now

{"app":"index","message":"Exception: An exception occurred while executing 'SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = ? AND \"argument\" = ?':\n\nSQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^ - Verursacht durch: SQLSTATE[42P01]: Undefined table: 7 FEHLER:  Relation \u201eoc_jobs\u201c existiert nicht\nLINE 1: SELECT \"id\" FROM \"oc_jobs\" WHERE \"class\" = $1 AND \"argument\"...\n                         ^[42P01] ","level":4,"time":"2013-12-11T22:34:52+00:00"}

@bartv2 suspiciously looks like the backticks did not get replaced with the correct quotes ... \u203e is „ and \u201c is “ ... the correct quote is " the simple double quote ...

butonic · 2013-12-11T22:58:43Z

nevermind the quotes are just part of the error message ... so this is more related to oc_jobs really not being present...

abompard · 2013-12-12T09:54:27Z

@kabum is right, on PostgreSQL the generated upgrade SQL is ALTER TABLE "pictures_images_cache" ALTER width SET, which is obviously incomplete. This happens when a database column is set to NOT NULL without any DEFAULT. Then the getDefaultValueDeclarationSQL() method in 3rdparty/doctrine/dbal/lib/Doctrine/DBAL/Platforms/AbstractPlatform.php generates an empty string, which is just appended to the SQL command without checking.

karlitschek · 2013-12-12T10:02:40Z

linking this here owncloud-archive/3rdparty#64 (comment)

AceSlash · 2013-12-12T12:00:03Z

Same issue on Debian 7.0 using the official repository with a postgresql database. upgrade just fail with the official 6.0 release.

sven-ola · 2013-12-12T14:37:50Z

Ah - fixed later. Sorry for bugging.

As a note to https://github.com/owncloud/apps/commit/74ca2bd8e0d85cae0c783031e036421f832b99ad and https://github.com/owncloud/apps/commit/0c6f6c52c16f85e28280e1621fb4d7a691c60d0c: you shure not having
$currentVersion=OC_Appconfig::getValue('search_lucene', 'installed_version');

is correct in preupdate.php?

PVince81 · 2013-12-12T18:31:04Z

I'm getting the oc_jobs error now when I upgrade from 5.0.13 to stable6, with SQLite (by checking out the corresponding tags in core, apps and 3rdparty)

karlitschek · 2013-12-12T18:57:07Z

@butonic @DeepDiver1975 Any idea?

PVince81 · 2013-12-12T19:24:32Z

I think I'm onto something:

When the migration problem appeared for me, I had an older config.php with mysql DB settings but that I reset with installed: false and used sqlite. That caused the oc_jobs issue to appear.

Then, when I deleted the config.php and started from scratch, and only manually added the apps_path, then migration works fine.

karlitschek · 2013-12-12T19:25:13Z

strange

PVince81 · 2013-12-12T19:25:21Z

My intuition tells me "table prefix". Need to verify this. Because it's probably the only extra DB setting that is used for SQLite.

PVince81 · 2013-12-12T19:27:31Z

Hmm, just saw that this bug was marked as duplicate of #6294 but by rereading the first post, it seems to be related to pictures table. I'll switch over to that other bug that more explicitly states my issue.
Feel free to follow me there 😉

brot · 2013-12-18T18:34:45Z

Is there any progress on this issue? Is there a workaround for the postrgres users? As far as I saw this problem also occured with the RC versions? Is there a fix now for the stable release?

PVince81 · 2013-12-18T19:19:05Z

@brot I'm not sure but you can try upgrading from 5.0.13 to 6.0.0a (not 6.0.0)
6.0.0a contains many fixes related to migration (to which this ticket might be a side effect)

brot · 2013-12-18T22:28:58Z

@PVince81 and where do I find the 6.0.0a download file?

PVince81 · 2013-12-18T22:30:32Z

Here: http://owncloud.org/install/
Click on "Tar or Zip file" then "Unix"

dsu-igeek · 2013-12-24T15:40:53Z

This patch allowed me to get through the upgrade. Not sure if the database is in the correct state but it seems to work. This just skips the ALTER TABLE when the default value is blank.

--- a/doctrine/dbal/lib/Doctrine/DBAL/Platforms/PostgreSqlPlatform.php
+++ b/doctrine/dbal/lib/Doctrine/DBAL/Platforms/PostgreSqlPlatform.php
@@ -378,7 +378,7 @@ class PostgreSqlPlatform extends AbstractPlatform
$sql[] = 'ALTER TABLE ' . $diff->name . ' ' . $query;
}

       if ($columnDiff->hasChanged('default')) {

       if ($columnDiff->hasChanged('default') && strlen($this->getDefaultValueDeclarationSQL($column->toArray())) > 0) {
         $query = 'ALTER ' . $oldColumnName . ' SET ' . $this->getDefaultValueDeclarationSQL($column->toArray());
         $sql[] = 'ALTER TABLE ' . $diff->name . ' ' . $query;

PVince81 · 2014-01-07T09:26:01Z

Not sure but could be related: owncloud-archive/3rdparty#65 (comment)

PVince81 · 2014-02-06T16:43:34Z

Any update ? Did you have any success upgrading to 6.0.1 with Postgres ?

brot · 2014-02-06T18:00:00Z

For me the version 6.0.1 worked. Thanks

karlitschek closed this as completed Dec 11, 2013

wolkenschieber mentioned this issue Dec 11, 2013

Upgrade from 5.0.13 to 6.0.0 (search lucene) failed #6313

Closed

MorrisJobke reopened this Dec 11, 2013

karlitschek mentioned this issue Dec 12, 2013

Update from oc6 beta4 to rc3 fails #6285

Closed

This was referenced Dec 12, 2013

Upgrading to 6 RC2 fails with Postgresql #6190

Closed

Update from OC5.0.13 to OC6RC4 - Base table or view not found: 1146 Table 'owncloud.oc_jobs' doesn't exist #6294

Closed

karlitschek mentioned this issue Dec 12, 2013

File Share dialog doesn't appear #6327

Closed

PVince81 mentioned this issue Dec 12, 2013

add missing default definition #6346

Closed

PVince81 mentioned this issue Dec 12, 2013

Update problem from 5.13 to 6: An exception occurred while executing #6363

Closed

typomedia mentioned this issue Dec 12, 2013

OwnCloud 6 OpenLDAP authentication problem #6369

Closed

blizzz mentioned this issue Dec 13, 2013

Upgrade from 5.0.13 to 6.0.0 correct but strange admin password reset... #6357

Closed

karlitschek closed this as completed Feb 6, 2014

lock bot locked as resolved and limited conversation to collaborators Aug 19, 2019

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Upgrade to 6.0.0 fails #6330

Upgrade to 6.0.0 fails #6330

wolkenschieber commented Dec 11, 2013

karlitschek commented Dec 11, 2013

wolkenschieber commented Dec 11, 2013

wolkenschieber commented Dec 11, 2013

MorrisJobke commented Dec 11, 2013

MorrisJobke commented Dec 11, 2013

butonic commented Dec 11, 2013

butonic commented Dec 11, 2013

abompard commented Dec 12, 2013

karlitschek commented Dec 12, 2013

AceSlash commented Dec 12, 2013

sven-ola commented Dec 12, 2013

PVince81 commented Dec 12, 2013

karlitschek commented Dec 12, 2013

PVince81 commented Dec 12, 2013

karlitschek commented Dec 12, 2013

PVince81 commented Dec 12, 2013

PVince81 commented Dec 12, 2013

brot commented Dec 18, 2013

PVince81 commented Dec 18, 2013

brot commented Dec 18, 2013

PVince81 commented Dec 18, 2013

dsu-igeek commented Dec 24, 2013

PVince81 commented Jan 7, 2014

PVince81 commented Feb 6, 2014

brot commented Feb 6, 2014

Upgrade to 6.0.0 fails #6330

Upgrade to 6.0.0 fails #6330

Comments

wolkenschieber commented Dec 11, 2013

karlitschek commented Dec 11, 2013

wolkenschieber commented Dec 11, 2013

wolkenschieber commented Dec 11, 2013

MorrisJobke commented Dec 11, 2013

MorrisJobke commented Dec 11, 2013

butonic commented Dec 11, 2013

butonic commented Dec 11, 2013

abompard commented Dec 12, 2013

karlitschek commented Dec 12, 2013

AceSlash commented Dec 12, 2013

sven-ola commented Dec 12, 2013

PVince81 commented Dec 12, 2013

karlitschek commented Dec 12, 2013

PVince81 commented Dec 12, 2013

karlitschek commented Dec 12, 2013

PVince81 commented Dec 12, 2013

PVince81 commented Dec 12, 2013

brot commented Dec 18, 2013

PVince81 commented Dec 18, 2013

brot commented Dec 18, 2013

PVince81 commented Dec 18, 2013

dsu-igeek commented Dec 24, 2013

PVince81 commented Jan 7, 2014

PVince81 commented Feb 6, 2014

brot commented Feb 6, 2014