Ensuring we're always importing snippets with lists and hyperlinks

Even when they're smaller than threshold
polterguy · Oct 9, 2023 · cbe9c86 · cbe9c86
1 parent 7999fa8
commit cbe9c86
Showing 1 changed file with 7 additions and 1 deletion.
diff --git a/backend/files/system/openai/magic.startup/crawling/magic.ai.url.scrape.hl b/backend/files/system/openai/magic.startup/crawling/magic.ai.url.scrape.hl
@@ -446,11 +446,17 @@ slots.create:magic.ai.url.scrape
                               get-value:x:@.arguments/*/threshold
                            strings.starts-with:x:@.dp/#/*/completion
                               .:![
+                           strings.contains:x:@.dp/#/*/completion
+                              .:"* "
+                           strings.contains:x:@.dp/#/*/completion
+                              .:"1. "
+                           strings.contains:x:@.dp/#/*/completion
+                              .:"["
                         .lambda
 
                            /*
                             * Snippet is longer than minimum threshold for import, or snippet is
-                            * an image.
+                            * an image, contains list elements, or hyperlinks.
                             *
                             * Verifying user can create more snippets.
                             *