BLOB not found [JDBC411] #452

firebird-automations · 2015-10-16T15:17:09Z

Submitted by: Attila Molnár (e_pluribus_unum)

Hi Mark!

On one [read-write, read-commited] thread I update a blob column in a record. On an other [read, read-commited] thread I read that record from DB. The two thread are concurrent read and write can occure on the same time. Sometimes I get "BLOB" not found error.
It looks like this problem : http://www.lnssoftware.ca/blog/?p=67

Is this a JayBird bug, or Firebird bug?
Using [read, snapshot] transaction on the reader thread could solve the problem?

Thank you!

firebird-automations · 2015-10-16T15:47:30Z

Modified by: Attila Molnár (e_pluribus_unum)

description: Hi Mark!

On one [read-write, read-commited] thread I update a blob column in a record. On an other [read, read-commited] thread I read that record from DB. The two thread are concurrent read and write can occure on the same time. Sometimes I get "BLOB" not found error.
It looks like this problem : http://www.lnssoftware.ca/blog/?p=67

Is this a JayBird bug, or Firebird bug?
Using [read, snapshot] transaction on the reader thread cound solve the problem?

Thank you!

=>

Hi Mark!

On one [read-write, read-commited] thread I update a blob column in a record. On an other [read, read-commited] thread I read that record from DB. The two thread are concurrent read and write can occure on the same time. Sometimes I get "BLOB" not found error.
It looks like this problem : http://www.lnssoftware.ca/blog/?p=67

Is this a JayBird bug, or Firebird bug?
Using [read, snapshot] transaction on the reader thread could solve the problem?

Thank you!

firebird-automations · 2015-10-16T17:59:59Z

Commented by: @mrotteveel

Could you create a reproduction case, that makes it easier to analyze.

firebird-automations · 2015-10-19T13:50:02Z

Commented by: Attila Molnár (e_pluribus_unum)

Hi!

Here is my test program.
Unfortunatly this in itself cannot reproduce the error for me but maybe for you.
BUT running the test and run "select * from test" with IBExpert in [read, read-commited] it shows the same BLOB not found error. When I switch to [read, snapshot] transaction in IBExpert the error disappears.
So this looks like an error in the FB engine itself freeeing blob id too soon.

public class JDBC402 {

public class DBThread extends Thread \{

	protected BasicDataSource ds;
	protected Connection conn;

	public DBThread\(\)
		throws SQLException \{

		super\(\);
		ds = new BasicDataSource\(\);
		ds\.setUrl\("jdbc:firebirdsql:l3s\-server/3051:d:\\\\jdbc\-402\.fdb?charSet=UTF\-8&isc\_dpb\_sql\_dialect=1"\);
		ds\.setUsername\("SYSDBA"\);
		ds\.setPassword\("masterkey"\);
		ds\.setMaxIdle\(\-1\);
		ds\.setDefaultAutoCommit\(false\);
		ds\.setDefaultReadOnly\(true\);
		ds\.setDefaultTransactionIsolation\(Connection\.TRANSACTION\_READ\_COMMITTED\);
		conn = ds\.getConnection\(\);
		start\(\);
	\}
\}

public class ThreaRead extends DBThread \{

	Integer id;
	String data;

	public ThreaRead\(\)
		throws SQLException \{

		super\(\);
	\}

	@Override
	public void run\(\) \{

		try \{
			while \(\!interrupted\(\)\) \{
				conn\.setAutoCommit\(false\);
				conn\.setReadOnly\(true\);
				FirebirdConnection fc = \(FirebirdConnection\) conn\.unwrap\(FirebirdConnection\.class\);
				TransactionParameterBuffer tpb = fc\.createTransactionParameterBuffer\(\);
				tpb\.addArgument\(TransactionParameterBuffer\.READ\);
				tpb\.addArgument\(TransactionParameterBuffer\.READ\_COMMITTED\);
				tpb\.addArgument\(TransactionParameterBuffer\.REC\_VERSION\);
				tpb\.addArgument\(TransactionParameterBuffer\.NOWAIT\);
				fc\.setTransactionParameters\(tpb\);
				Statement s = fc\.createStatement\(\);
				try \(ResultSet rs = s\.executeQuery\("SELECT id, data FROM test"\)\) \{
					while \(rs\.next\(\)\) \{
						id = new Integer\(rs\.getInt\(1\)\);
						data = new String\(rs\.getString\(2\)\);
					\}
				\}
				conn\.commit\(\);
			\}
		\}
		catch \(Exception e\) \{
			e\.printStackTrace\(\);
		\}
	\}
\}

public class ThreaWrite extends DBThread \{

	public ThreaWrite\(\)
		throws SQLException \{

	\}

	@Override
	public void run\(\) \{

		try \{
			while \(\!interrupted\(\)\) \{
				int i = 1;
				while \(i <= 160\) \{
					conn\.setAutoCommit\(false\);
					conn\.setReadOnly\(false\);
					FirebirdConnection fc = \(FirebirdConnection\) conn\.unwrap\(FirebirdConnection\.class\);
					TransactionParameterBuffer tpb = fc\.createTransactionParameterBuffer\(\);
					tpb\.addArgument\(TransactionParameterBuffer\.WRITE\);
					tpb\.addArgument\(TransactionParameterBuffer\.READ\_COMMITTED\);
					tpb\.addArgument\(TransactionParameterBuffer\.REC\_VERSION\);
					tpb\.addArgument\(TransactionParameterBuffer\.NOWAIT\);
					fc\.setTransactionParameters\(tpb\);
					PreparedStatement s = conn\.prepareStatement\("UPDATE test SET data = ? WHERE id = ?"\);
					s\.setObject\(1, new Date\(\)\.toString\(\)\);
					s\.setObject\(2, i\);
					s\.execute\(\);
					conn\.commit\(\);
					i\+\+;
				\}
			\}
		\}
		catch \(SQLException e\) \{
			e\.printStackTrace\(\);
		\}
	\}
\}


public JDBC402\(\)
	throws SQLException,
		InterruptedException \{

	ThreaRead read = new ThreaRead\(\);
	ThreaWrite write = new ThreaWrite\(\);
	while \(\!read\.interrupted\(\)\)
		Thread\.sleep\(1\);
	while \(\!write\.interrupted\(\)\)
		Thread\.sleep\(1\);
\}


public static void main\(
	String\[\] args\)
	throws Throwable \{

	JDBC402 app = new JDBC402\(\);
\}

}

firebird-automations · 2015-10-19T13:50:42Z

Modified by: Attila Molnár (e_pluribus_unum)

Attachment: JDBC402.ZIP [ 12823 ]

firebird-automations · 2015-10-19T14:07:50Z

Commented by: Attila Molnár (e_pluribus_unum)

The call stack in the application :

hu.libra.lreserver.process.ProcessException: org.firebirdsql.jdbc.FBSQLException: GDS Exception. 335544382. BLOB not found
hu.libra.lreserver.process.ProcessException: org.firebirdsql.jdbc.FBSQLException: GDS Exception. 335544382. BLOB not found
at hu.libra.lreserver.jobs.async.ReportJob$ReportJobTask.trySetState(ReportJob.java:620)
at hu.libra.lreserver.process.AbstractProcess.finished(AbstractProcess.java:264)
at hu.libra.lreserver.process.AbstractProcess$1.run(AbstractProcess.java:237)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at hu.libra.lreserver.wrappers.autocloseable.ExecutorWithThread$ExecutorThread.run(ExecutorWithThread.java:59)
Caused by: org.firebirdsql.jdbc.FBSQLException: GDS Exception. 335544382. BLOB not found
at org.firebirdsql.jdbc.FBStatementFetcher.fetch(FBStatementFetcher.java:176)
at org.firebirdsql.jdbc.FBStatementFetcher.next(FBStatementFetcher.java:97)
at org.firebirdsql.jdbc.AbstractResultSet.next(AbstractResultSet.java:285)
at org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:191)
at org.apache.commons.dbcp2.DelegatingResultSet.next(DelegatingResultSet.java:191)
at hu.libra.commons.db.resultset.ConverterResultSet.next(ConverterResultSet.java:126)
at hu.libra.commons.db.resultset.PartitionedResultSet.next(PartitionedResultSet.java:105)
at hu.libra.lrecommons.objects.RptReportDataView.<init>(RptReportDataView.java:45)
at hu.libra.lrecommons.objects.RptReportJob.<init>(RptReportJob.java:51)
at hu.libra.lrecommons.utils.DBUtilsRead.selectRptReportJob(DBUtilsRead.java:1303)
at hu.libra.lrecommons.utils.DBUtilsRead.selectRptReportJob(DBUtilsRead.java:1322)
at hu.libra.lreserver.storage.RptReportJobList.refreshReportJob(RptReportJobList.java:95)
at hu.libra.lreserver.jobs.async.ReportJob$ReportJobTask.cacheRefresh(ReportJob.java:518)
at hu.libra.lreserver.jobs.async.ReportJob$ReportJobTask.trySetState(ReportJob.java:607)
... 5 more
Caused by: org.firebirdsql.gds.GDSException: BLOB not found
at org.firebirdsql.gds.impl.wire.AbstractJavaGDSImpl.readStatusVector(AbstractJavaGDSImpl.java:2092)
at org.firebirdsql.gds.impl.wire.AbstractJavaGDSImpl.receiveResponse(AbstractJavaGDSImpl.java:2042)
at org.firebirdsql.gds.impl.wire.AbstractJavaGDSImpl.iscDsqlFetch(AbstractJavaGDSImpl.java:1322)
at org.firebirdsql.gds.impl.GDSHelper.fetch(GDSHelper.java:272)
at org.firebirdsql.jdbc.FBStatementFetcher.fetch(FBStatementFetcher.java:171)
... 18 more

firebird-automations · 2015-10-19T15:36:31Z

Commented by: @mrotteveel

Thanks, I will see if I can reproduce this after I get 2.2.9 out the door. I have two theories: either the new blob id is selected and not yet considered visible to the transaction when opening the blob, or the old blob id is already garbage collected even though the transaction might still have an interest. Playing around with the fetch size might have an effect on the reproducibility. I will see if I can narrow it down and report a bug on CORE if necessary.

firebird-automations · 2015-10-19T15:44:07Z

Commented by: @mrotteveel

One last question: Which Firebird version do you use (version + type (classic, superclassic, superserver))?

firebird-automations · 2015-10-20T07:20:23Z

Modified by: Attila Molnár (e_pluribus_unum)

environment: 2.5.4, x64, SuperClassic, Windows

firebird-automations · 2016-01-21T09:46:12Z

Commented by: Attila Molnár (e_pluribus_unum)

CORE5078 might be related?

firebird-automations · 2016-01-21T10:36:06Z

Commented by: @mrotteveel

It might be. But I see you use SuperClassic, not sure if that makes a difference here though.

firebird-automations · 2016-01-22T10:14:02Z

Commented by: Attila Molnár (e_pluribus_unum)

Tested with latest 2.5.6. snapshot which has CORE5078 fix.
The problem still occures, not the same case. (This is a concurrency problem, that was not)

firebird-automations · 2016-01-22T10:16:25Z

Commented by: Attila Molnár (e_pluribus_unum)

I think this is a CORE/engine problem not JDBC.

firebird-automations · 2016-03-23T12:51:17Z

Commented by: @mrotteveel

I haven't yet found the exact combination that triggers it. I was able to trigger it from flamerobin when running your sample application, so it looks like it is indeed a problem (expected?) of the engine, and not Jaybird itself.

firebird-automations · 2017-02-13T16:51:19Z

Commented by: Attila Molnár (e_pluribus_unum)

I got same error when the reader thread Connection/transaction is in [read, snapshot] mode
So snapshot is not a solution to this problem just a very effective, but not 100% percent working workaround. (Nearly 1 year passed and I just got this error for the first time)

firebird-automations · 2020-01-11T13:20:56Z

Commented by: malkovich

I am also interested in this information, I will wait for an answer.

firebird-automations added affect-version: Jaybird 2.2.8 priority: major component: jdbc driver type: bug labels Apr 25, 2021

firebird-automations assigned mrotteveel Apr 25, 2021

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BLOB not found [JDBC411] #452

BLOB not found [JDBC411] #452

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 20, 2015

firebird-automations commented Jan 21, 2016

firebird-automations commented Jan 21, 2016

firebird-automations commented Jan 22, 2016

firebird-automations commented Jan 22, 2016

firebird-automations commented Mar 23, 2016

firebird-automations commented Feb 13, 2017

firebird-automations commented Jan 11, 2020

BLOB not found [JDBC411] #452

BLOB not found [JDBC411] #452

Comments

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 16, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 19, 2015

firebird-automations commented Oct 20, 2015

firebird-automations commented Jan 21, 2016

firebird-automations commented Jan 21, 2016

firebird-automations commented Jan 22, 2016

firebird-automations commented Jan 22, 2016

firebird-automations commented Mar 23, 2016

firebird-automations commented Feb 13, 2017

firebird-automations commented Jan 11, 2020