ollama embedding interrupts randomly with "ValueError("embedding not set.")" #1723
Comments
|
Small update: |
|
I think it must somehow break on special characters? Since it happens to the same files each time... For now I'm using the code below to keep going and not break on specific Documents: |
|
I have a feeling Documents / pages must break because of a weird character? These are the problematic docs (not sensitive info):{'id_': 'fdd692a8-51fa-4a66-b00a-83b4add7cd39', 'embedding': None, 'metadata': {'page_label': 'iii', 'file_name': 'svn-book.pdf', 'doc_id': 'fdd692a8-51fa-4a66-b00a-83b4add7cd39'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "iiiTable of Contents\nForeword ..............................................................................................................................................................xi\nPreface...............................................................................................................................................................xiii\nWhat Is Subversion? ....................................................................................................................................xiii\nIs Subversion the Right Tool? ...............................................................................................................xiii\nSubversion's History .............................................................................................................................xiv\nSubversion's Architecture .......................................................................................................................xv\nSubversion's Components .....................................................................................................................xvii\nWhat's New in Subversion ...................................................................................................................xvii\nAudience ..................................................................................................................................................xviii\nHow to Read This Book ...............................................................................................................................xix\nOrganization of This Book .............................................................................................................................xx\nThis Book Is Free ........................................................................................................................................xxi\nAcknowledgments ........................................................................................................................................xxi\n1. Fundamental Concepts .........................................................................................................................................1\nVersion Control Basics ....................................................................................................................................1\nThe Repository ......................................................................................................................................1\nThe Working Copy .................................................................................................................................2\nVersioning Models .................................................................................................................................2\nVersion Control the Subversion Way .................................................................................................................7\nSubversion Repositories ...........................................................................................................................7\nRevisions ..............................................................................................................................................7\nAddressing the Repository .......................................................................................................................8\nSubversion Working Copies .....................................................................................................................9\nSummary .....................................................................................................................................................14\n2. Basic Usage .....................................................................................................................................................15\nHelp!..........................................................................................................................................................15\nGetting Data into Your Repository ..................................................................................................................16\nImporting Files and Directories ...............................................................................................................16\nRecommended Repository Layout ...........................................................................................................17\nWhat's In a Name? ...............................................................................................................................17\nCreating a Working Copy ..............................................................................................................................18\nBasic Work Cycle .........................................................................................................................................19\nUpdate Your Working Copy ...................................................................................................................20\nMake Your Changes ..............................................................................................................................20\nReview Your Changes ...........................................................................................................................21\nFix Your Mistakes ................................................................................................................................25\nResolve Any Conflicts ...........................................................................................................................26\nCommit Your Changes ..........................................................................................................................32\nExamining History ........................................................................................................................................33\nExamining the Details of Historical Changes .............................................................................................34\nGenerating a List of Historical Changes ...................................................................................................35\nBrowsing the Repository ........................................................................................................................37\nFetching Older Repository Snapshots .......................................................................................................39\nSometimes You Just Need to Clean Up ............................................................................................................40\nDisposing of a Working Copy ................................................................................................................40\nRecovering from an Interruption .............................................................................................................40\nDealing with Structural Conflicts .....................................................................................................................41\nAn Example Tree Conflict .....................................................................................................................42\nSummary .....................................................................................................................................................46\n3. Advanced Topics ..............................................................................................................................................47\nRevision Specifiers .......................................................................................................................................47", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '54009569-8906-4d62-a673-a1371b2ca798', 'embedding': None, 'metadata': {'page_label': 'iv', 'file_name': 'svn-book.pdf', 'doc_id': '54009569-8906-4d62-a673-a1371b2ca798'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "Version Control with Subversion\nivRevision Keywords ...............................................................................................................................47\nRevision Dates .....................................................................................................................................48\nPeg and Operative Revisions ..........................................................................................................................49\nProperties ....................................................................................................................................................53\nWhy Properties? ...................................................................................................................................54\nManipulating Properties .........................................................................................................................55\nProperties and the Subversion Workflow ..................................................................................................58\nAutomatic Property Setting .....................................................................................................................60\nFile Portability .............................................................................................................................................60\nFile Content Type .................................................................................................................................61\nFile Executability ..................................................................................................................................62\nEnd-of-Line Character Sequences ............................................................................................................62\nIgnoring Unversioned Items ............................................................................................................................63\nKeyword Substitution ....................................................................................................................................66\nSparse Directories .........................................................................................................................................70\nLocking.......................................................................................................................................................74\nCreating Locks .....................................................................................................................................75\nDiscovering Locks ................................................................................................................................77\nBreaking and Stealing Locks ..................................................................................................................78\nLock Communication ............................................................................................................................80\nExternals Definitions .....................................................................................................................................81\nChangelists ..................................................................................................................................................86\nCreating and Modifying Changelists ........................................................................................................87\nChangelists As Operation Filters .............................................................................................................89\nChangelist Limitations ...........................................................................................................................90\nNetwork Model ............................................................................................................................................90\nRequests and Responses .........................................................................................................................91\nClient Credentials .................................................................................................................................91\nSummary .....................................................................................................................................................94\n4. Branching and Merging ......................................................................................................................................95\nWhat's a Branch? ..........................................................................................................................................95\nUsing Branches ............................................................................................................................................95\nCreating a Branch .................................................................................................................................97\nWorking with Your Branch ....................................................................................................................98\nThe Key Concepts Behind Branching .....................................................................................................101\nBasic Merging ............................................................................................................................................101\nChangesets .........................................................................................................................................101\nKeeping a Branch in Sync ....................................................................................................................102\nSubtree Merges and Subtree Mergeinfo ..................................................................................................105\nReintegrating a Branch .........................................................................................................................107\nMergeinfo and Previews .......................................................................................................................109\nUndoing Changes ................................................................................................................................113\nResurrecting Deleted Items ...................................................................................................................114\nAdvanced Merging ......................................................................................................................................115\nCherrypicking .....................................................................................................................................115\nMerge Syntax: Full Disclosure ..............................................................................................................117\nMerges Without Mergeinfo ...................................................................................................................118\nMore on Merge Conflicts .....................................................................................................................119\nBlocking Changes ...............................................................................................................................121\nKeeping a Reintegrated Branch Alive .....................................................................................................122\nMerge-Sensitive Logs and Annotations ...................................................................................................123\nNoticing or Ignoring Ancestry ...............................................................................................................125\nMerges and Moves ..............................................................................................................................126\nPreventing Naïve Clients from Committing Merges ..................................................................................126", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '18ee1df8-e205-4e50-b921-cb0e05be8d2b', 'embedding': None, 'metadata': {'page_label': 'v', 'file_name': 'svn-book.pdf', 'doc_id': '18ee1df8-e205-4e50-b921-cb0e05be8d2b'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "Version Control with Subversion\nvThe Final Word on Merge Tracking .......................................................................................................127\nTraversing Branches ....................................................................................................................................128\nTags..........................................................................................................................................................129\nCreating a Simple Tag .........................................................................................................................130\nCreating a Complex Tag ......................................................................................................................130\nBranch Maintenance ....................................................................................................................................131\nRepository Layout ...............................................................................................................................131\nData Lifetimes ....................................................................................................................................132\nCommon Branching Patterns .........................................................................................................................132\nRelease Branches ................................................................................................................................133\nFeature Branches .................................................................................................................................133\nVendor Branches .........................................................................................................................................134\nGeneral Vendor Branch Management Procedure .......................................................................................135\nsvn_load_dirs.pl ..................................................................................................................................136\nTo Branch or Not to Branch? ........................................................................................................................137\nSummary ...................................................................................................................................................138\n5. Repository Administration .................................................................................................................................140\nThe Subversion Repository, Defined ..............................................................................................................140\nStrategies for Repository Deployment .............................................................................................................141\nPlanning Your Repository Organization ..................................................................................................141\nDeciding Where and How to Host Your Repository ..................................................................................143\nChoosing a Data Store .........................................................................................................................144\nCreating and Configuring Your Repository ......................................................................................................146\nCreating the Repository ........................................................................................................................147\nImplementing Repository Hooks ............................................................................................................147\nBerkeley DB Configuration ..................................................................................................................149\nFSFS Configuration .............................................................................................................................149\nRepository Maintenance ...............................................................................................................................149\nAn Administrator's Toolkit ...................................................................................................................149\nCommit Log Message Correction ...........................................................................................................153\nManaging Disk Space ..........................................................................................................................153\nBerkeley DB Recovery ........................................................................................................................157\nMigrating Repository Data Elsewhere .....................................................................................................158\nFiltering Repository History ..................................................................................................................162\nRepository Replication .........................................................................................................................165\nRepository Backup ..............................................................................................................................171\nManaging Repository UUIDs ................................................................................................................173\nMoving and Removing Repositories ...............................................................................................................174\nSummary ...................................................................................................................................................174\n6. Server Configuration ........................................................................................................................................175\nOverview ...................................................................................................................................................175\nChoosing a Server Configuration ...................................................................................................................176\nThe svnserve Server ............................................................................................................................176\nsvnserve over SSH ..............................................................................................................................176\nThe Apache HTTP Server ....................................................................................................................177\nRecommendations ...............................................................................................................................177\nsvnserve, a Custom Server ............................................................................................................................178\nInvoking the Server .............................................................................................................................178\nBuilt-in Authentication and Authorization ...............................................................................................182\nUsing svnserve with SASL ..................................................................................................................184\nTunneling over SSH ............................................................................................................................186\nSSH Configuration Tricks .....................................................................................................................187\nhttpd, the Apache HTTP Server .....................................................................................................................188\nPrerequisites .......................................................................................................................................189", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '49b22b71-8ee4-44ba-9417-e0f00776e276', 'embedding': None, 'metadata': {'page_label': 'vi', 'file_name': 'svn-book.pdf', 'doc_id': '49b22b71-8ee4-44ba-9417-e0f00776e276'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "Version Control with Subversion\nviBasic Apache Configuration ..................................................................................................................189\nAuthentication Options .........................................................................................................................191\nAuthorization Options ..........................................................................................................................194\nProtecting network traffic with SSL .......................................................................................................197\nExtra Goodies .....................................................................................................................................199\nPath-Based Authorization .............................................................................................................................206\nHigh-level Logging .....................................................................................................................................210\nServer Optimization .....................................................................................................................................212\nData Caching ......................................................................................................................................212\nNetwork Compression of Data ..............................................................................................................213\nSupporting Multiple Repository Access Methods ..............................................................................................213\n7. Customizing Your Subversion Experience ...........................................................................................................215\nRuntime Configuration Area .........................................................................................................................215\nConfiguration Area Layout ...................................................................................................................215\nConfiguration and the Windows Registry ................................................................................................216\nConfiguration Options ..........................................................................................................................217\nLocalization ...............................................................................................................................................223\nUnderstanding Locales .........................................................................................................................223\nSubversion's Use of Locales .................................................................................................................224\nUsing External Editors .................................................................................................................................225\nUsing External Differencing and Merge Tools .................................................................................................226\nExternal diff .......................................................................................................................................226\nExternal diff3 .....................................................................................................................................227\nExternal merge ...................................................................................................................................229\nSummary ...................................................................................................................................................230\n8. Embedding Subversion .....................................................................................................................................231\nLayered Library Design ...............................................................................................................................231\nRepository Layer .................................................................................................................................232\nRepository Access Layer ......................................................................................................................235\nClient Layer .......................................................................................................................................236\nUsing the APIs ...........................................................................................................................................237\nThe Apache Portable Runtime Library ....................................................................................................237\nFunctions and Batons ...........................................................................................................................238\nURL and Path Requirements .................................................................................................................238\nUsing Languages Other Than C and C++ ................................................................................................239\nCode Samples .....................................................................................................................................240\nSummary ...................................................................................................................................................245\n9. Subversion Complete Reference .........................................................................................................................247\nsvn—Subversion Command-Line Client ..........................................................................................................247\nsvn Options ........................................................................................................................................247\nsvn Subcommands ...............................................................................................................................255\nsvnadmin—Subversion Repository Administration ............................................................................................329\nsvnadmin Options ...............................................................................................................................329\nsvnadmin Subcommands ......................................................................................................................331\nsvnlook—Subversion Repository Examination .................................................................................................352\nsvnlook Options ..................................................................................................................................352\nsvnlook Subcommands .........................................................................................................................354\nsvnsync—Subversion Repository Mirroring .....................................................................................................374\nsvnsync Options ..................................................................................................................................374\nsvnsync Subcommands .........................................................................................................................376\nsvnrdump—Remote Subversion Repository Data Migration ................................................................................384\nsvnrdump Options ...............................................................................................................................384\nsvnrdump Subcommands ......................................................................................................................385\nsvnserve—Custom Subversion Server .............................................................................................................388", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '65cf02fb-bb9f-43ed-b21b-4fda9ce2438e', 'embedding': None, 'metadata': {'page_label': 'vii', 'file_name': 'svn-book.pdf', 'doc_id': '65cf02fb-bb9f-43ed-b21b-4fda9ce2438e'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Version Control with Subversion\nviisvnserve Options .................................................................................................................................389\nsvndumpfilter—Subversion History Filtering ...................................................................................................390\nsvndumpfilter Options ..........................................................................................................................390\nsvndumpfilter Subcommands .................................................................................................................391\nsvnversion—Subversion Working Copy Version Info ........................................................................................396\nmod_dav_svn—Subversion Apache HTTP Server Module .................................................................................398\nmod_authz_svn—Subversion Apache HTTP Authorization Module .....................................................................401\nSubversion Properties ..................................................................................................................................402\nVersioned Properties ............................................................................................................................402\nUnversioned Properties ........................................................................................................................403\nRepository Hooks ........................................................................................................................................404\nA. Subversion Quick-Start Guide ...........................................................................................................................414\nInstalling Subversion ...................................................................................................................................414\nHigh-Speed Tutorial ....................................................................................................................................414\nB. Subversion for CVS Users ................................................................................................................................417\nRevision Numbers Are Different Now ............................................................................................................417\nDirectory Versions ......................................................................................................................................417\nMore Disconnected Operations ......................................................................................................................418\nDistinction Between Status and Update ...........................................................................................................418\nStatus................................................................................................................................................418\nUpdate...............................................................................................................................................419\nBranches and Tags ......................................................................................................................................419\nMetadata Properties .....................................................................................................................................420\nConflict Resolution ......................................................................................................................................420\nBinary Files and Translation .........................................................................................................................420\nVersioned Modules ......................................................................................................................................420\nAuthentication ............................................................................................................................................421\nConverting a Repository from CVS to Subversion ............................................................................................421\nC. WebDAV and Autoversioning ...........................................................................................................................422\nWhat Is WebDAV? .....................................................................................................................................422\nAutoversioning ...........................................................................................................................................423\nClient Interoperability ..................................................................................................................................424\nStandalone WebDAV Applications .........................................................................................................425\nFile-Explorer WebDAV Extensions ........................................................................................................426\nWebDAV Filesystem Implementation .....................................................................................................427\nD. Copyright ......................................................................................................................................................429\nIndex.................................................................................................................................................................435', 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': 'fb007252-ba80-47b8-b849-a36e90fa6f8c', 'embedding': None, 'metadata': {'page_label': 'x', 'file_name': 'svn-book.pdf', 'doc_id': 'fb007252-ba80-47b8-b849-a36e90fa6f8c'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "xList of Examples\n4.1. Merge-tracking gatekeeper start-commit hook script ............................................................................................127\n5.1. txn-info.sh (reporting outstanding transactions) ..................................................................................................154\n5.2. Mirror repository's pre-revprop-change hook script .............................................................................................166\n5.3. Mirror repository's start-commit hook script ......................................................................................................166\n6.1. A sample svnserve launchd job definition .........................................................................................................181\n6.2. A sample configuration for anonymous access ...................................................................................................195\n6.3. A sample configuration for authenticated access .................................................................................................196\n6.4. A sample configuration for mixed authenticated/anonymous access .......................................................................196\n6.5. Disabling path checks altogether ......................................................................................................................197\n7.1. Sample registration entries (.reg) file ................................................................................................................216\n7.2. diffwrap.py ..................................................................................................................................................227\n7.3. diffwrap.bat ..................................................................................................................................................227\n7.4. diff3wrap.py .................................................................................................................................................228\n7.5. diff3wrap.bat ................................................................................................................................................228\n7.6. mergewrap.py ...............................................................................................................................................229\n7.7. mergewrap.bat ..............................................................................................................................................229\n8.1. Using the repository layer ..............................................................................................................................240\n8.2. Using the repository layer with Python .............................................................................................................242\n8.3. A Python status crawler .................................................................................................................................243", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '3b729a2b-13c7-4ac4-a8b9-f87726576828', 'embedding': None, 'metadata': {'page_label': '46', 'file_name': 'svn-book.pdf', 'doc_id': '3b729a2b-13c7-4ac4-a8b9-f87726576828'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Basic Usage\n46Index: code/foo.c\n===================================================================\n--- code/foo.c (revision 14)\n+++ code/foo.c (working copy)\n@@ -3,5 +3,5 @@\n int main(int argc, char *argv[])\n {\n printf("I don't like being moved around!\n%s", bar());\n- return 0;\n+ return 1;\n }\nIndex: code/bar.c\n===================================================================\n--- code/bar.c (revision 14)\n+++ code/bar.c (working copy)\n@@ -1,4 +1,4 @@\n const char *bar(void)\n {\n- return "Me neither!\n";\n+ return "Well, I do like being moved around!\n";\n }\nIndex: code/baz.c\n===================================================================\n--- code/baz.c (revision 14)\n+++ code/baz.c (working copy)\n@@ -1,4 +0,0 @@\n-const char *bar(void)\n-{\n- return "Me neither!\n";\n-}\nIndex: Makefile\n===================================================================\n--- Makefile (revision 14)\n+++ Makefile (working copy)\n@@ -1,2 +1,2 @@\n foo: \n- {'id_': 'c43ac3ff-f8b2-4008-ba78-7acb16473892', 'embedding': None, 'metadata': {'page_label': '123', 'file_name': 'svn-book.pdf', 'doc_id': 'c43ac3ff-f8b2-4008-ba78-7acb16473892'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Branching and Merging\n123If you now try to merge outstanding changes from trunk to your branch, Subversion will consider changes made in revision X as\neligible for merging into the branch. However, since your branch already contains all the changes made in revision X, merging these\nchanges can result in spurious conflicts! These conflicts are often tree conflicts, especially if renames were made on the branch or\nthe trunk while the branch was in development.\nSo what can be done about this? We need to make sure that Subversion does not try to merge revision X into the branch. This is done\nusing the --record-only merge option, which was introduced in the section called “Blocking Changes” .\nTo carry out the record-only merge, get a working copy of the branch which was just reintegrated in revision X, and merge just\nrevision X from trunk into your branch, making sure to use the --record-only option.\nThis merge uses the cherry-picking merge syntax, which was introduced in the section called “Cherrypicking” . Continuing with the\nrunning example from the section called “Reintegrating a Branch” , where revision X was revision 391:\n$ cd my-calc-branch\n$ svn update\nUpdating '.':\nUpdated to revision 393.\n$ svn merge --record-only -c 391 ^/calc/trunk\n--- Recording mergeinfo for merge of r391 into '.':\n U .\n$ svn commit -m "Block revision 391 from being merged into my-calc-branch."\nSending .\nCommitted revision 394.\nNow your branch is ready to soak up changes from the trunk again. After another sync of your branch to the trunk, you can even\nreintegrate the branch a second time. If necessary, you can do another record-only merge to keep the branch alive. Rinse and repeat.\nIt should now also be apparent why deleting the branch and re-creating it has the same effect as doing the above record-only merge.\nBecause revision X is part of the natural history (see the sidebar Natural History and Implicit Mergeinfo ) of the newly created branch,\nSubversion will never attempt to merge revision X into the branch, avoiding spurious conflicts.\nMerge-Sensitive Logs and Annotations\nOne of the main features of any version control system is to keep track of who changed what, and when they did it. The svn log and\nsvn blame subcommands are just the tools for this: when invoked on individual files, they show not only the history of changesets\nthat affected the file, but also exactly which user wrote which line of code, and when she did it.\nWhen changes start getting replicated between branches, however, things start to get complicated. For example, if you were to ask\nsvn log about the history of your feature branch, it would show exactly every revision that ever affected the branch:\n$ cd my-calc-branch\n$ svn log -q\n------------------------------------------------------------------------\nr390 | user | 2002-11-22 11:01:57 -0600 (Fri, 22 Nov 2002)\n------------------------------------------------------------------------\nr388 | user | 2002-11-21 05:20:00 -0600 (Thu, 21 Nov 2002)\n------------------------------------------------------------------------\nr381 | user | 2002-11-20 15:07:06 -0600 (Wed, 20 Nov 2002)\n------------------------------------------------------------------------\nr359 | user | 2002-11-19 19:19:20 -0600 (Tue, 19 Nov 2002)\n------------------------------------------------------------------------', 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': 'c181a337-060e-485b-81d8-2688653c50ed', 'embedding': None, 'metadata': {'page_label': '124', 'file_name': 'svn-book.pdf', 'doc_id': 'c181a337-060e-485b-81d8-2688653c50ed'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': "Branching and Merging\n124r357 | user | 2002-11-15 14:29:52 -0600 (Fri, 15 Nov 2002)\n------------------------------------------------------------------------\nr343 | user | 2002-11-07 13:50:10 -0600 (Thu, 07 Nov 2002)\n------------------------------------------------------------------------\nr341 | user | 2002-11-03 07:17:16 -0600 (Sun, 03 Nov 2002)\n------------------------------------------------------------------------\nr303 | sally | 2002-10-29 21:14:35 -0600 (Tue, 29 Oct 2002)\n------------------------------------------------------------------------\nr98 | sally | 2002-02-22 15:35:29 -0600 (Fri, 22 Feb 2002)\n------------------------------------------------------------------------\nBut is this really an accurate picture of all the changes that happened on the branch? What's left out here is the fact that revisions\n390, 381, and 357 were actually the results of merging changes from the trunk. If you look at one of these logs in detail, the multiple\ntrunk changesets that comprised the branch change are nowhere to be seen:\n$ svn log -v -r 390\n------------------------------------------------------------------------\nr390 | user | 2002-11-22 11:01:57 -0600 (Fri, 22 Nov 2002) | 1 line\nChanged paths:\n M /branches/my-calc-branch/button.c\n M /branches/my-calc-branch/README\nFinal merge of trunk changes to my-calc-branch.\nWe happen to know that this merge to the branch was nothing but a merge of trunk changes. How can we see those trunk changes\nas well? The answer is to use the --use-merge-history (-g) option. This option expands those “child” changes that were\npart of the merge.\n$ svn log -v -r 390 -g\n------------------------------------------------------------------------\nr390 | user | 2002-11-22 11:01:57 -0600 (Fri, 22 Nov 2002) | 1 line\nChanged paths:\n M /branches/my-calc-branch/button.c\n M /branches/my-calc-branch/README\nFinal merge of trunk changes to my-calc-branch.\n------------------------------------------------------------------------\nr383 | sally | 2002-11-21 03:19:00 -0600 (Thu, 21 Nov 2002) | 2 lines\nChanged paths:\n M /branches/my-calc-branch/button.c\nMerged via: r390\nFix inverse graphic error on button.\n------------------------------------------------------------------------\nr382 | sally | 2002-11-20 16:57:06 -0600 (Wed, 20 Nov 2002) | 2 lines\nChanged paths:\n M /branches/my-calc-branch/README\nMerged via: r390\nDocument my last fix in README.\nBy making the log operation use merge history, we see not just the revision we queried (r390), but also the two revisions that came\nalong on the ride with it—a couple of changes made by Sally to the trunk. This is a much more complete picture of history!", 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '696ad019-0852-4f77-83a2-4b47164142f8', 'embedding': None, 'metadata': {'page_label': '275', 'file_name': 'svn-book.pdf', 'doc_id': '696ad019-0852-4f77-83a2-4b47164142f8'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Subversion Complete Reference\n275$ svn diff http://svn.collab.net/repos/svn/trunk/COMMITTERS@3000 \\n http://svn.collab.net/repos/svn/trunk/COMMITTERS@3500\nIndex: COMMITTERS\n===================================================================\n--- COMMITTERS (revision 3000)\n+++ COMMITTERS (revision 3500)\n…\nCompare revision 3000 to revision 3500 using range notation (pass only the one URL in this case):\n$ svn diff -r 3000:3500 http://svn.collab.net/repos/svn/trunk/COMMITTERS\nIndex: COMMITTERS\n===================================================================\n--- COMMITTERS (revision 3000)\n+++ COMMITTERS (revision 3500)\n…\nCompare revision 3000 to revision 3500 of all the files in trunk using range notation:\n$ svn diff -r 3000:3500 http://svn.collab.net/repos/svn/trunk\nCompare revision 3000 to revision 3500 of only three files in trunk using range notation:\n$ svn diff -r 3000:3500 --old http://svn.collab.net/repos/svn/trunk \\n COMMITTERS README HACKING\nIf you have a working copy, you can obtain the differences without typing in the long URLs:\n$ svn diff -r 3000:3500 COMMITTERS \nIndex: COMMITTERS\n===================================================================\n--- COMMITTERS (revision 3000)\n+++ COMMITTERS (revision 3500)\n…\nUse --diff-cmd CMD --extensions (-x) to pass arguments directly to the external diff program:\n$ svn diff --diff-cmd /usr/bin/diff -x "-i -b" COMMITTERS \nIndex: COMMITTERS\n===================================================================\n0a1,2\n> This is a test\n> \n$\nLastly, you can use the --xml option along with the --summarize option to view XML describing the changes that occurred\nbetween revisions, but not the contents of the diff itself:\n$ svn diff --summarize --xml http://svn.red-bean.com/repos/test@r2 \\n http://svn.red-bean.com/repos/test', 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': '99f538ab-7e6a-4c8e-a90e-201aa7e7545c', 'embedding': None, 'metadata': {'page_label': '282', 'file_name': 'svn-book.pdf', 'doc_id': '99f538ab-7e6a-4c8e-a90e-201aa7e7545c'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Subversion Complete Reference\n282It will also show information for directories:\n$ svn info vendors\nPath: vendors\nWorking Copy Root Path: /home/sally/projects/test\nURL: http://svn.red-bean.com/repos/test/vendors\nRepository Root: http://svn.red-bean.com/repos/test\nRepository UUID: 5e7d134a-54fb-0310-bd04-b611643e5c25\nRevision: 19\nNode Kind: directory\nSchedule: normal\nLast Changed Author: harry\nLast Changed Rev: 19\nLast Changed Date: 2003-01-16 23:21:19 -0600 (Thu, 16 Jan 2003)\nProperties Last Updated: 2003-01-16 23:39:02 -0600 (Thu, 16 Jan 2003)\nsvn info also acts on URLs (also note that the file readme.doc in this example is locked, so lock information is also provided):\n$ svn info http://svn.red-bean.com/repos/test/readme.doc\nPath: readme.doc\nName: readme.doc\nURL: http://svn.red-bean.com/repos/test/readme.doc\nRepository Root: http://svn.red-bean.com/repos/test\nRepository UUID: 5e7d134a-54fb-0310-bd04-b611643e5c25\nRevision: 1\nNode Kind: file\nSchedule: normal\nLast Changed Author: sally\nLast Changed Rev: 42\nLast Changed Date: 2003-01-14 23:21:19 -0600 (Tue, 14 Jan 2003)\nLock Token: opaquelocktoken:14011d4b-54fb-0310-8541-dbd16bd471b2\nLock Owner: harry\nLock Created: 2003-01-15 17:35:12 -0600 (Wed, 15 Jan 2003)\nLock Comment (1 line):\nMy test lock comment\nLastly, svn info output is available in XML format by passing the --xml option:\n$ svn info --xml http://svn.red-bean.com/repos/test\n\n\n<entry\n kind="dir"\n path="."\n revision="1">\nhttp://svn.red-bean.com/repos/test\n\nhttp://svn.red-bean.com/repos/test\n5e7d134a-54fb-0310-bd04-b611643e5c25\n\n\nnormal', 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} {'id_': 'b0c7593a-42d0-4ce1-9820-13633161b11e', 'embedding': None, 'metadata': {'page_label': '290', 'file_name': 'svn-book.pdf', 'doc_id': 'b0c7593a-42d0-4ce1-9820-13633161b11e'}, 'excluded_embed_metadata_keys': ['doc_id'], 'excluded_llm_metadata_keys': ['file_name', 'doc_id', 'page_label'], 'relationships': {}, 'text': 'Subversion Complete Reference\n290r14 | …\n------------------------------------------------------------------------\n------------------------------------------------------------------------\nr19 | …\n------------------------------------------------------------------------\n------------------------------------------------------------------------\nr27 | …\n------------------------------------------------------------------------\nYou can avoid the clutter of the double dashed lines in your output by using the --incremental option:\n$ svn log --incremental -r 14 > mylog\n$ svn log --incremental -r 19 >> mylog\n$ svn log --incremental -r 27 >> mylog\n$ cat mylog\n------------------------------------------------------------------------\nr14 | …\n------------------------------------------------------------------------\nr19 | …\n------------------------------------------------------------------------\nr27 | …\nThe --incremental option provides similar output control when using the --xml option:\n$ svn log --xml --incremental -r 1 sandwich.txt\n<logentry\n revision="1">\nharry\n2008-06-03T06:35:53.048870Z\nInitial Import.\n\nSometimes when you run svn log on a specific path and a specific revision, you see no log information output at all,\nas in the following:\n$ svn log -r 20 http://svn.red-bean.com/untouched.txt\n------------------------------------------------------------------------\nThat just means the path wasn't modified in that revision. To get log information for that revision, either run the log\noperation against the repository's root URL, or specify a path that you happen to know was changed in that revision:\n$ svn log -r 20 touched.txt \n------------------------------------------------------------------------\nr20 | sally | 2003-01-17 22:56:19 -0600 (Fri, 17 Jan 2003) | 1 line\nMade a change.', 'start_char_idx': None, 'end_char_idx': None, 'text_template': '{metadata_str}\n\n{content}', 'metadata_template': '{key}: {value}', 'metadata_seperator': '\n'} |
|
It's been fixed.
|
When ingesting file(s) through the GUI with ollama embedding (nomic-embed-text), I get the impression some pages (pdf) succesfully get ingested, but after a couple I keep getting the error below.
Edit: Actually I'm sure some pages of the pdf were ingested succesfully, since I saw Documents being deleted when deleting through the GUI.
Does anyone have a clue as of how to fix this?
The text was updated successfully, but these errors were encountered: