Night Sky Pi

Night Sky Pi is a camera that takes images throughout the night currently from sunset till sunrise. These images are then zipped then the application waits for the next observation period. Along with the images that are taken there are supporting json files for each image with additional information. These data files currently contain the exposure and observation information for the image, allowing for processing off device later.

There could be additional json files created by other supporting applications. The Night Sky Pi can use MQTT to publish events so one could write other applications that respond to these events to complete additional task. One example would be to add weather information to the json file. Note: MQTT is not required for standard operation only for other applications to interact with the data in a timely manner.

Hardware

Night Sky Pi has been created with certain hardware in mind. Wanting to keep the application simple, small and low cost the hardware that Night Sky Pi has targeted is the Raspberry Pi Zero 2 W. That being said any Raspberry Pi more capable than this model should work fine. The camera used and tested is the Raspberry Pi HQ Camera, however the standard camera model could be used ensuring that the exposure times within the configuration are kept within the models capabilities.

Prerequisites

Before deploying the Night Sky Pi it's important to ensure that you have the following configured as there are dependencies. However the installation of an MQTT broker is optional I usually have it installed instead of needing to remember to do it when starting up other applications.

Python

Night Sky Pi is written in Python and has been tested with the following Python versions:

Python 3.9
Python 3.10
Python 3.11
Python 3.12

The nsp.sh runs within a virtual environment based on what's on your system path.

MQTT Broker

Night Sky Pi has the ability to publish events to an MQTT broker. The intent of this is so that other modules can react to the events to complete additional actions. Initially this broker will only run locally therefore only allow clients that reside on the same device as intended. Firstly we need to install MQTT on the Raspberry Pi.

sudo apt update && sudo apt upgrade
sudo apt install -y mosquitto
sudo apt install -y mosquitto-clients # Optional for testing locally
sudo systemctl enable mosquitto.service
sudo reboot # Just something I like to do, this is optional as well

The next step is to configure the Night Sky Pi to use the MQTT broker, as MQTT events are disabled by default.

"device" : {
    "mqtt" : {
        "enabled": true,
        "host": "127.0.0.1"
    }
}

Configuration

All configuration of the Night Sky Pi is done through the config.json, which is passed into the Night Sky Pi as an argument. It's best not to update the configuration within the repository but to copy it to another location and use that for running the Night Sky Pi.

Configuration Items

The json file structure is as follows:

device : details
logging : details
data : details
nsp : details

Device

name : Friendly name for the camera
location : The location of the camera, this is used to calculate sun position.
- latitude : double for the latitude of the device
- longitude : double for the longitude of the device
mqtt : MQTT settings for the device
- enabled : boolean if enabled, mqtt is disabled by default
- host : location of mqtt broker, default and recommended is localhost

Logging

path : location of the log file
level : the level at which to log at
format : log formatting options
- date : how to represent dates
- output : how to print log statements
rotation : logging roll over settings
- size : the size of the log file before rolling over
- backup : the number of old log files to keep before deletion

Data

path : Root directory to save all created data

NSP

observation_cooldown : Time to wait in minutes between the end of an observation and starting housekeeping
data : details
logging : details
capture : details

NSP Data

path : location to save the observations, this path will be appended to the root data path
house_keeping : housekeeping configuration
- delete_after : number of days to keep archived observation data, if set to 0 then no data is ever deleted

NSP Logging

file : set the name of the logging file for the Night Sky Pi
level : override the logging level of the Night Sky Pi logging file

NSP Capture

shutter : Shutter speed time of exposure in microseconds
- initial : Starting shutter speed in microseconds
- slowest : Slowest allowed shutter speed in microseconds
- fastest : Fastest allowed shutter speed in microseconds
gain : Sensitivity of the camera sensor
- initial : Starting gain represented as a double
- lowest : Lowest gain represented as a double
- highest : Highest gain represented as a double
white_balance : The white balance settings
- red : Amount of red used for white balance represented as a double
- blue : Amount of blue used for white balance represented as a double
exposure : Desired exposure settings
- target : The desired brightness of the image represented as a double 0.00 black while 1.00 white
- delay : The time between taking images in seconds
- tolerance : Different between the image brightness and target exposure before recalculating new image capture settings
format : Options to save the captured image
- file : currently only supports "jpg"
timeout_seconds: Time to state that the image capture failed default is 90 seconds. This should always be more than the slowest shutter speed.

Running Night Sky Pi

It's recommended that Night Sky Pi is run as a service. This ensures that it doesn't stop of user logging off and on system restarts to do this carry out the following.

# current working directory is the night sky pi repository.
sudo cp nsp.service /etc/systemd/system/nsp.service
sudo nano /etc/systemd/system/nsp.service

Next step is to update the service definition to the correct paths and running as the correct user.

[Unit]
Description=Night Sky Pi
After=network.target

[Service]
Type=Simple
# update this to be your current user
User=username 
# the location of the night sky pi repository
WorkingDirectory=/home/username/repositories/night-sky-pi 
# update these paths to be the location of the nsp.sh 
# update argument to where you previously copied the json configuration.
ExecStart=/home/username/repositories/night-sky-pi/nsp.sh /home/username/config.json 
Restart=on-failure

[Install]
WantedBy=multi-user.target

Next is to enable and start the service.

sudo systemctl daemon-reload
sudo systemctl start nsp
sudo systemctl enable nsp

Outputs

During an observation period there will be a folder created with the observation date as configured in the json file. Within this directory there will be two directories. First is the images directory where the captured images are stored with the filename being the timestamp of capture. The second directory is the data directory that contains any created json or artifacts from other modules.

Once the observations has completed house keeping will delete any old files if configured. Then the last observation will be zipped with the same name as the observation data, and the source folder is deleted.

MQTT

If MQTT has been enabled on Night Sky Pi, there are a couple of events that are fired through the running of the application.

Observation Started

When an observation starts and the file structure has been created Night Sky Pi will fire an event to the "nsp/observation-started" topic, below is an example of what to expect in the message payload.

{
    "observation": {
        "date": "2024-09-04",
        "start": "2024-09-04T19:38:00+01:00",
        "end": "2024-09-05T06:19:00+01:00"
    },
    "data": {
        "path": "/home/joseph/nsp/data/observations/2024-09-04/",
        "root_path": "/home/joseph/nsp/data/observations/",
        "observation_image_path": "/home/joseph/nsp/data/observations/2024-09-04/images/",
        "observation_data_path": "/home/joseph/nsp/data/observations/2024-09-04/data/"
    }
}

Image Captured

Each and every time that an image has been captured and saved to disk. Night Sky Pi will publish a message to the "nsp/image-captured" topic, below is an example of what to expect in the message payload.

{
    "observation": {
        "date": "2024-09-04",
        "start": "2024-09-04T19:38:00+01:00",
        "end": "2024-09-05T06:19:00+01:00"
    },
    "data": {
        "path": "/home/joseph/nsp/data/observations/2024-09-04/",
        "root_path": "/home/joseph/nsp/data/observations/",
        "observation_image_path": "/home/joseph/nsp/data/observations/2024-09-04/images/",
        "observation_data_path": "/home/joseph/nsp/data/observations/2024-09-04/data/"
    },
    "exposure": {
        "shutter": 0.25,
        "gain": 1,
        "white_balance": {
            "red": 2.8,
            "blue": 1.7
        }
    },
    "image": {
        "path": "/home/joseph/nsp/data/observations/2024-09-04/images/1725490896.jpg",
        "format": ".jpg",
        "filename": "1725490896"
    }
}

Observation Completed

When an observation has reached it's completed datetime Night Sky Pi will fire an event to the "nsp/observation-ended" topic, below is an example of what to expect in the message payload.

{
    "observation": {
        "date": "2024-09-04",
        "start": "2024-09-04T19:38:00+01:00",
        "end": "2024-09-05T06:19:00+01:00"
    },
    "data": {
        "path": "/home/joseph/nsp/data/observations/2024-09-04/",
        "root_path": "/home/joseph/nsp/data/observations/",
        "observation_image_path": "/home/joseph/nsp/data/observations/2024-09-04/images/",
        "observation_data_path": "/home/joseph/nsp/data/observations/2024-09-04/data/"
    }
}

Archive Deleted

During house keeping there is an configuration option to delete zipped archives that are older than a configured number of days. If enabled and an archive is deleted, Night Sky Pi will fire an event to the "nsp/file-deleted" topic, below is an example of what to expect in the message payload.

{
    "file": "/home/joseph/nsp/data/observations/2024-08-30.zip"
}

Archive Completed

After the observation and housekeeping the Night Sky Pi will archive the entire observation folder. This operation can take a while once completed, Night Sky Pi will fire an event to the "nsp/archive-completed" topic, below is an example of what to expect in the message payload.

{
    "name": "2024-09-04",
    "format": "zip",
    "folder" : "/home/joseph/nsp/data/observations/",
    "path": "/home/joseph/nsp/data/observations/2024-09-04.zip"
}

Contributing

Contributions are what make the open-source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

Don't forget to give the project a star! Thanks again!

Fork the Project
Create your Feature Branch (git checkout -b feature/AmazingFeature)
Commit your Changes (git commit -m 'Add some AmazingFeature')
Push to the Branch (git push origin feature/AmazingFeature)
Open a Pull Request

License

This project is licensed under the MIT License - see the LICENSE file for details.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

README.md

README.md

Night Sky Pi

Hardware

Prerequisites

Python

MQTT Broker

Configuration

Configuration Items

Device

Logging

Data

NSP

NSP Data

NSP Logging

NSP Capture

Running Night Sky Pi

Outputs

MQTT

Observation Started

Image Captured

Observation Completed

Archive Deleted

Archive Completed

Contributing

License

Files

README.md

Latest commit

History

README.md

File metadata and controls

Night Sky Pi

Hardware

Prerequisites

Python

MQTT Broker

Configuration

Configuration Items

Device

Logging

Data

NSP

NSP Data

NSP Logging

NSP Capture

Running Night Sky Pi

Outputs

MQTT

Observation Started

Image Captured

Observation Completed

Archive Deleted

Archive Completed

Contributing

License