Expose posix fs settings

[aduffeck]

ocis companion PR for cs3org/reva#4562

Example settings for gpfs with the gpfswatchfolder watcher:

"STORAGE_USERS_DRIVER": "posix",
"STORAGE_USERS_POSIX_ROOT": "/ibm/fs1/storage-users",
"STORAGE_USERS_POSIX_WATCH_TYPE": "gpfswatchfolder",
"STORAGE_USERS_POSIX_WATCH_PATH": "fs1_audit", // the kafka topic to watch
"STORAGE_USERS_POSIX_WATCH_FOLDER_KAFKA_BROKERS": "192.168.1.180:29092",
"STORAGE_USERS_ID_CACHE_STORE": "redis",
"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:6379",

[update-docs]

Thanks for opening this pull request! The maintainers of this repository would appreciate it if you would create a changelog item based on your changes.

[sonarcloud]

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[butonic]

when inotify is used this is actually overwritten with the posix root path:

	watchPath := o.WatchPath
	var err error
	switch o.WatchType {
	case "gpfswatchfolder":
		t.watcher, err = NewGpfsWatchFolderWatcher(t, strings.Split(o.WatchFolderKafkaBrokers, ","))
		if err != nil {
			return nil, err
		}
	case "gpfsfileauditlogging":
		t.watcher, err = NewGpfsFileAuditLoggingWatcher(t, o.WatchPath)
		if err != nil {
			return nil, err
		}
	default:
		t.watcher = NewInotifyWatcher(t)
		watchPath = o.Root
	}

[butonic]

Using

"STORAGE_USERS_DRIVER": "posix",
"STORAGE_USERS_POSIX_ROOT": "/home/jfd/ocis-posix",

on first login I get an error in the log

2024-05-29T11:19:24+02:00 ERR failed to list storage spaces error="error reading user index: stat /home/jfd/ocis-posix/indexes/by-user-id/some-admin-user-id-0000-000000000000.mpk: no such file or directory" filters=[{"Term":{"SpaceType":"project"},"type":4},{"Term":{"User":{"idp":"https://cloud.ocis.test","opaque_id":"some-admin-user-id-0000-000000000000"}},"type":6}] line=/home/jfd/Repositories/reva/internal/grpc/services/storageprovider/storageprovider.go:575 pkg=rgrpc service=storage-users status={"code":15,"message":"error listing spaces","trace":"10838818faa9f6ef276aeed0574143eb"} traceid=10838818faa9f6ef276aeed0574143eb

and I do not get a space in the web ui

[butonic]

was fixed by enabling redis with

					"STORAGE_USERS_ID_CACHE_STORE": "redis",
					"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:6379",

[butonic]

When creating files and directories via cli they would get assimilated, but the browser listing would not change when reloading the page. The cause was that the web ui somehow was using old spaceids ... cached somewhere. when cutting everything but the domain web would pick up the new personal spaceid and new files would show up properly.

[butonic]

ok, only issues I am aware of:

• nats-js-kv does not seem to work, fine for now

  				//"STORAGE_USERS_ID_CACHE_STORE": "nats-js-kv",
  				//"STORAGE_USERS_ID_CACHE_STORE_NODES": "127.0.0.1:9233",
  

• weird web ui caching where it remembers the old personal spaceid from a session with ocis using default decomposedfs where the userid will become the personal spaceid.
• it seems two inotifywait processes are started ... one for the dataprovider and on for the storageprovider?
• on arch inotify-tools must be installed for the default STORAGE_USERS_POSIX_WATCH_TYPE=inotifywait

[butonic]

no blockers from my POV

[sonarcloud]

Quality Gate passed

Issues
1 New issue
0 Accepted issues

Measures
0 Security Hotspots
21.7% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[johnmmcgee]

Has this currently be added to a release? I do not see mention in the changelogs.