Add higher level tritonserver API

[jbkyang-nvi]

With https://github.com/triton-inference-server/developer_tools/tree/main/server,
Triton added a C++ API that is higher level API for the original API.
This PR adds tritonserverwrapper project that makes use of that API. It is higher than the
Javacpp/tritonserverwrapper project

[saudet]

Thanks! Instead of adding a new module though, I think we could simply update the original tritonserver one with the new "tritonserverwrapper"? BTW, we typically name these presets after the library names, which is in this case "tritondevelopertoolsserver"...

[jbkyang-nvi]

Thanks! Instead of adding a new presets though, I think we could simply update the original tritonserver one with the new "tritonserverwrapper"? BTW, we typically these modules after the library names, which is in this case "tritondevelopertoolsserver"...

tritonserver wraps around the CAPI and the new tritondevelopertoolsserver API wraps around a higher level version of that. I think both work a little differently and it would be nice to have them as different projects, if that makes sense.

[saudet]

It makes it harder to maintain and for users to use as well. Let's please not do that. I'm not going to maintain them in that form myself and they are currently not functional because they are missing too many configurations. How about this, if you're not going to maintain the C interface, let's nuke it?

[jbkyang-nvi]

Updated the PR. I noticed there's some issues caused by updating the tritonserver.h from 23.04 to 23.05 though comparison link. Through this PR: triton-inference-server/core#192 we made tritonserver.h conform to proper C standard (vs C++ standard).

tritonserver.java created seemed to be confused and ommited a few functions that used defined variables.: 63431c6#diff-0b23a69d7a0bd76ec9fff99224228855a84574ccaf9185df0c5d774ba00dc933

I tried to use cpptext and it also did not solve the problem locally. Is there anything else I should be doing? I checked, and 23.04 seems to be compiling fine.
e90149b

[saudet]

Right now it's not failing because of that, but because of this:

2023-06-10T02:51:14.7189856Z ../cppbuild.sh: line 10: INCLUDE_DEVELOPER_TOOLS_SERVER: unbound variable

Let's start by fixing this

[saudet]

I've fixed the parser issue with function pointers in commit bytedeco/javacpp@b9f91d7 so it should work fine now.

[jbkyang-nvi]

@saudet Thanks for your help! It looks like samples/Simple.java is running fine but the example for samples/SimpleCPP.java does not work. Is this something with how platform/pom.xml is written?

[saudet]

What do you mean by does not work? What's the error message that you get?

[jbkyang-nvi]

What do you mean by does not work? What's the error message that you get?

It simply does not find the C++ binding files. I checked in the compiled jar and it seems like all the generated java files are in there

[saudet]

Could you run the sample with mvn clean compile exec:java -Dorg.bytedeco.java.logger.debug and copy/paste here what that outputs?

[jbkyang-nvi]

Could you run the sample with mvn clean compile exec:java -Dorg.bytedeco.java.logger.debug and copy/paste here what that outputs?

I think I found the reason of the failure. Thanks. Let me know if there's anything else that needs to be changed

[jbkyang-nvi]

@saudet I've addressed the comments. Anything else to do before merging to master?

[saudet]

Looks good! Thanks