The future of the smart glasses.

[SirEndii]

Describe your idea

The upcoming 0.8 update is set to bring a significant transformation to our AR Glasses, to the extent that I've entirely replaced the old system with a new one and rebranded them as Smart Glasses.

I'm initiating this issue request to establish a centralized place for discussing the forthcoming developments and desired features for these glasses.

Furthermore, to enhance the centralization of our Smart Glasses' future, I will compile a list of all presently open issues related to Smart Glasses/AR Goggles:

Features:

• Screen width, height, and FOV function and Rotation(?) for the AR Goggles/Controller Advanced-Peripherals-Features#26, Feature: function for getting AR goggle resolution  Advanced-Peripherals-Features#50 More debug functions to retrieve more information about the player/the screen
• Player right / left click sensor Advanced-Peripherals-Features#52 Player Events
• AR Goggles Polygon & Non axis locked lines Advanced-Peripherals-Features#53 Enhanced rendering functions like polygons
• [Feature] 3d Options for the AR glasses Advanced-Peripherals-Features#57 3D Rendering
• Ar glasses Hotkey Advanced-Peripherals-Features#13 Hotkeys
• [Feature] Adding a neural interface & kinetic module? Advanced-Peripherals-Features#17, AR controller Pocket PC Advanced-Peripherals-Features#25 Kinetic Module (?)
• [Feature] GUI Peripheral Advanced-Peripherals-Features#58 A way to render GUIs (?)
• [Feature Request] Allow Smart Glasses to teleport player into a virtual dimension which controlled by CC script Advanced-Peripherals-Features#3 A Full VR Mode (?)
• [Feature] remote keyboards Advanced-Peripherals-Features#59 A keyboard integrated as a module
• Night Vision Module

Bugs (Since the old system is gone, these bugs should also be gone):

• AR Goggles - Hot Bar Blinks Advanced-Peripherals-Features#44
• AR-Controller: calling "getPlayerRotationY/Z" throws a Null-Exception for the owner #307 Unexpected NPEs
• Negative numbers for from bottom/right of screen to left/up don't work on AR goggles #379 Weird behavior with the coordinates
• Transparency for the AR glasses Advanced-Peripherals-Features#24 Transparency (More or less already fixed)

Features marked with (?) are just ideas which will not be 100% added to the game

When I finished a specific feature, I will post pictures and upload jars to test them

The progress for the 0.8 update is also "documented" via the commits on GitHub →Branch 0.8

[PABessero]

About the coordinates system:

Will it be absolute (in world / MC coords)
or relative (either to the block the goggles are linked to, or the player that has the goggles)

Same question for the dimensions, at least for the AR part

[SirEndii]

About the coordinates system:

Will it be absolute (in world / MC coords) or relative (either to the block the goggles are linked to, or the player that has the goggles)

Same question for the dimensions, at least for the AR part

Discussable

To retrieve player coords? Absolute and relative, the dimension would be an extra property you can retrieve from the glasses.
To retrieve coords from blocks/objects in the world? Also, probably both, but I would make it configurable to disable absolute coordinates

Note that there isn't a block anymore. So all coordinates would be relative to the player's eye position
I am gonna post some pictures in a minute

[SirEndii]

small preview

The glasses with three peripherals and the overlay module:

[zyxkad]

I want the glasses can render 3D blocks if possible, so we can use computer to make 3D games. It maybe have to create another dimension. If the works are to heavy for you then nvm.

[SirEndii]

That's a thing I will 99,9% add to the glasses. 🙂

[PalTheTaur]

For the 3D rendering, we would definitely need some way of rendering mass blocks instead of 1 by 1, though, the mention of 3D games by the person above, could maybe have a “VR mode” where it just is a whole different world and the computer is free to overwrite blocks and stuff, but that is definitely excessive.

[SirEndii]

Yeah, that's such a thing I want to discuss when I start making the feature
How players think the endpoint should look like

[zyxkad]

I opened an issue for it IntelligenceModding/Advanced-Peripherals-Features#3

[PalTheTaur]

hey for the GUI peripheral idea, even without letting a whole custom GUI maker exist, A preset GUI based on some common vanilla and modded GUIs with some button events, and something like the inventory API would be a good way to atleast have a basic version, but a custom GUI would be killer.

Would also save me from having this janky thing I currently have set up in my world with ender chests mod.

[bmartin127]

will 1.18.2 have this new system?

[SirEndii]

@bmartin127
If I have the motivation and time to backport this, yeah
I guess I will backport this, but I need to see how much work this acutally is.

[getkirill]

can't wait for smart glasses to be added :)

[SirEndii]

Finally got some time to work on the glasses
Got object syncing to the client done and basic rendering

(This is a YouTube video, you can click on it)

[SirEndii]

This is my current test script
It deletes the objects that were created before(from another script)
Creates two with some different sizes and colors
Waits a second and then changes the color and size of the objects for testing

The objects are always in sync with the client. If one was updated via a function, it syncs the changes to the client and displays the change without deleting the old object and creating a new one. Essentially preventing flickering.

test = peripheral.wrap("back")

test.clear()
sleep(1)
panelOne = test.createPanel("one", {maxX = 160, maxY = 160})
panelTwo = test.createPanel("two", {opacity = 0.3, x = 500, y = 500, maxY = 40, maxX = 40, color = 0xFF8448})

sleep(1)
panelOne.setColor(0x003c9c)
panelTwo.setMaxX(300)

[nmgix]

Would be cool to get barebone version of goggles before 0.8, for sure it would ruin joy of full 0.8 release, but i would be happy even w/ only ability to draw basic shapes lol.
Anyway, good job keeping up the good work👍

[SirEndii]

Sure
I will try to publish a small preview of the documentation and a working 0.8 build
But note that I constantly change the api or add and remove features

[nmgix]

You are trying to scare me with ability to draw my full base on my goggles. The only question is what happened to that tool that gave ability to convert "paint" images (.nfp) to cc:t compatible? Didnt find source code as documentation is quite old

[awesomebossdj7]

are you going to add a entity sensor and a block scanner like plethora? you said you were planning on making smart glasses compatible with plethora scripts

[SirEndii]

I am unsure if I am even capable of adding plethora support
Currently everything is made from the ground up as a new api

The geo scanner will act as a block scanner since you can add peripherals to the glasses
And the environment detector can be used to detect entities