Broken federation?

[kromonos]

Issue Summary

Content from/to other instances doesn't seem to reach the endpoint.
e.g., https://fapsi.be/c/dnd ⇋ https://lemmy.ml/c/dnd@fapsi.be

Also: sometimes, when I try to open a remote community on my instance, I get a “Community not found” on first try. Second try mostly works, but not always.

Technical details

Docker logs are like:

lemmy_1     | [2021-10-29T10:26:23Z INFO  lemmy_apub::fetcher::fetch] Fetched remote object https://feddit.de/c/netzpolitik/moderators
lemmy_1     | [2021-10-29T10:26:23Z INFO  lemmy_apub::fetcher::fetch] Fetched remote object https://feddit.de/c/netzpolitik/outbox
lemmy_1     | [2021-10-29T10:26:23Z WARN  lemmy_utils] invalid type: string "https://feddit.de/c/netzpolitik", expected tuple struct ObjectId at line 1 column 540
lemmy_1     | [2021-10-29T10:41:43Z INFO  lemmy_apub::fetcher::fetch] Fetched remote object https://lemmy.ml/c/selfhosted/moderators
lemmy_1     | [2021-10-29T10:41:46Z INFO  lemmy_apub::fetcher::fetch] Fetched remote object https://lemmy.ml/c/selfhosted/outbox
lemmy_1     | [2021-10-29T10:41:46Z WARN  lemmy_utils] data did not match any variant of untagged enum AnnouncableActivities at line 1 column 1795

Running Lemmy 0.13.3
docker-compose version 1.21.2, build a133471
Docker version 20.10.10, build b485636

I've already restarted and recreated my containers, but nothing changed.

[dessalines]

Confirmed.

Post your docker-compose.yml and lemmy.hjson. Also make sure your system clock is up to date, we've had that problem before.

[kromonos]

Post your docker-compose.yml and lemmy.hjson.

I think I found the problem. As a PHP developer, I love it to make usage of \ in RegEx to define a whitespace. After I tested it with https://rustexp.lpil.uk/, I found this and replaced it with \s for the slur filter. Now I wait for some activity 😊

[kromonos]

OK, even after I removed the slur filter, I don't get any incoming changes.

version: '2.2'

services:
  postgres:
    image: postgres:12-alpine
    environment:
      - POSTGRES_USER=
      - POSTGRES_PASSWORD=
      - POSTGRES_DB=
    volumes:
      - ./volumes/postgres:/var/lib/postgresql/data
    restart: always

  lemmy:
    image: dessalines/lemmy:0.13.3
    ports:
      - "192.168.8.3:8536:8536"
    restart: always
    environment:
        - RUST_LOG="debug,lemmy_server=info,lemmy_api=info,lemmy_api_common=info,lemmy_api_crud=info,lemmy_apub=info,lemmy_apub_receive=info,lemmy_db_queries=info,lemmy_db_schema=info,lemmy_db_views=info,lemmy_db_views_actor=info,lemmy_db_views_moderator=info,lemmy_routes=info,lemmy_utils=info,lemmy_websocket=info"
        - NODE_TLS_REJECT_UNAUTHORIZED="0"
    volumes:
      - ./lemmy.hjson:/config/config.hjson
    depends_on:
      - postgres
      - pictrs
      - iframely

  lemmy-ui:
    image: dessalines/lemmy-ui:0.13.3
    ports:
      - "192.168.8.3:1235:1234"
    restart: always
    environment:
      - LEMMY_INTERNAL_HOST=lemmy:8536
      - LEMMY_EXTERNAL_HOST=localhost:8536
      - LEMMY_HTTPS=false
    depends_on: 
      - lemmy

  pictrs:
    image: asonix/pictrs:v0.2.6-r1
    ports: 
      - "192.168.8.3:8537:8080"
    user: 991:991
    environment:
      - RUST_LOG="debug"
    volumes:
      - ./volumes/pictrs:/mnt
    restart: always

  iframely:
    image: dogbin/iframely:latest
      #image: kfei/iframely:develop
    ports:
      - "8061:80"
    volumes:
      - ./iframely.config.local.js:/iframely/config.local.js:ro
      - ./volumes/whitelist:/iframely/whitelist
    restart: always
    mem_limit: 200m
    entrypoint:
      - node
      - server
      - -v

{
  hostname: "fapsi.be"
  bind: "0.0.0.0"
  port: 8536
  jwt_secret: ""
  pictrs_url: "http://pictrs:8080"
  actor_name_max_length: 32

  database: {
    database: "lemmy"
    user: ""
    password: ""
    host: ""
    port: 5432
    pool_size: 5
  }

  rate_limit: {
    message: 180
    message_per_second: 60
    post: 6
    post_per_second: 600
    register: 3
    register_per_second: 3600
    image: 6
    image_per_second: 3600
  }

  federation: {
    enabled: true
  }

  captcha: {
    enabled: true
    difficulty: medium # Can be easy, medium, or hard
  }

  email: {
    smtp_server: ""
    smtp_login: ""
    smtp_password: ""
    smtp_from_address: "noreply@bka.li"
    use_tls: true
  }
}

The slur filter I tried is available at https://code.bka.li/BKA.li/useful_files/src/branch/master/lemmy-slur_filter.hjson

[dessalines]

That looks fine to me. Did you see if its the system clock issue? Try updating your system clock then restarting.

[kromonos]

Ok, don't know what happened, but it just started to work again. 🤔
Time on my system and in the docker container seems good. The system time has an offset of -0.001081 sec.

[dessalines]

Apologies, this was this bug again, not your system time: #1820. Restarting lemmy.ml fixed it. Damn things running fine for 3 weeks then crashing. :(

[kromonos]

Apologies, this was this bug again, not your system time: #1820. Restarting lemmy.ml fixed it. Damn things running fine for 3 weeks then crashing. :(

No need to apology 😊 We all know, that Lemmy is still in development and bugs can happen 😊