Initial commit

Author: MarkP88

.gitattributes

@@ -0,0 +1,2 @@
+# Auto detect text files and perform LF normalization
+* text=auto

9781484237830.jpg

@@ -0,0 +1,14 @@
+# Contributing to Apress Source Code
+
+Copyright for Apress source code belongs to the author(s). However, under fair use you are encouraged to fork and contribute minor corrections and updates for the benefit of the author(s) and other readers.
+
+## How to Contribute
+
+1. Make sure you have a GitHub account.
+2. Fork the repository for the relevant book.
+3. Create a new branch on which to make your change, e.g. 
+`git checkout -b my_code_contribution`
+4. Commit your change. Include a commit message describing the correction. Please note that if your commit message is not clear, the correction will not be accepted.
+5. Submit a pull request.
+
+Thank you for your contribution!

Contributing.md

@@ -0,0 +1,27 @@
+Freeware License, some rights reserved
+
+Copyright (c) 2018 Sathyajith Bhat
+
+Permission is hereby granted, free of charge, to anyone obtaining a copy 
+of this software and associated documentation files (the "Software"), 
+to work with the Software within the limits of freeware distribution and fair use. 
+This includes the rights to use, copy, and modify the Software for personal use. 
+Users are also allowed and encouraged to submit corrections and modifications 
+to the Software for the benefit of other users.
+
+It is not allowed to reuse,  modify, or redistribute the Software for 
+commercial use in any way, or for a user’s educational materials such as books 
+or blog articles without prior permission from the copyright holder. 
+
+The above copyright notice and this permission notice need to be included 
+in all copies or substantial portions of the software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS OR APRESS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+
+

LICENSE.txt

@@ -0,0 +1,16 @@
+# Apress Source Code
+
+This repository accompanies [*Practical Docker with Python*](https://www.apress.com/9781484237830) by Sathyajith Bhat (Apress, 2018).
+
+[comment]: #cover
+![Cover image](9781484237830.jpg)
+
+Download the files as a zip using the green button, or clone the repository to your machine using Git.
+
+## Releases
+
+Release v1.0 corresponds to the code in the published book, without corrections or updates.
+
+## Contributions
+
+See the file Contributing.md for more information on how you can contribute to this repository.

README.md

@@ -0,0 +1,9 @@
+FROM python:3-alpine
+
+LABEL author="sathyabhat"
+LABEL description="Dockerfile for Python script which prints Hello, Name"
+
+COPY hello-world.py /app/
+ENV NAME=Sathya
+CMD python3 /app/hello-world.py
+

docker hello world/Dockerfile

@@ -0,0 +1,10 @@
+#!/usr/bin/env python3
+
+from os import getenv
+
+if getenv('NAME') is None:
+    name = 'World'
+else:
+    name = getenv('NAME')
+
+print("Hello, {}!".format(name))

docker hello world/hello-world.py

@@ -0,0 +1,9 @@
+FROM python:3-alpine
+
+COPY * /apps/subredditfetcher/
+WORKDIR /apps/subredditfetcher/
+RUN ["pip", "install", "-r", "requirements.txt"]
+
+ENV NBT_ACCESS_TOKEN="495637361:AAHIhiDTX1UeX17KJy0-FsMZEqEtCFYfcP8"
+
+CMD ["python", "newsbot.py"]

docker subreddit fetcher/Dockerfile

@@ -0,0 +1,22 @@
+The MIT License (MIT)
+
+Copyright (c) 2018 Sathya
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+

docker subreddit fetcher/LICENSE

@@ -0,0 +1 @@
+Bot which posts top submissions from a subreddit

docker subreddit fetcher/README.md

@@ -0,0 +1,11 @@
+__author__ = 'Sathyajith'
+
+import os
+ERR_NO_SOURCE = 'No sources defined! Set a source using /source list, of, sub, reddits'
+skip_list = []
+sources_dict = {}
+
+BOT_KEY = os.environ['NBT_ACCESS_TOKEN']
+API_BASE = 'https://api.telegram.org/bot'
+UPDATE_PERIOD = 6
+FALSE_RESPONSE = {"ok": False}

docker subreddit fetcher/constants.py

@@ -0,0 +1,22 @@
+from flask import Flask
+from newsbot import *
+from states import States
+
+bot = Flask(__name__)
+
+
+@bot.route('/index')
+def index():
+    return 'Thou shalt not pass!'
+
+
+@bot.route('/telegram-update', methods=['POST'])
+def telegram_update():
+    handle_incoming_messages(States.last_updated_id)
+
+
+if __name__ == '__main__':
+    States.last_updated_id = get_last_updated()
+    bot.run()
+
+

docker subreddit fetcher/main.py

@@ -0,0 +1,26 @@
+from states import States, log
+from telegram import handle_incoming_messages
+
+
+def get_last_updated():
+    try:
+        with open('last_updated.txt', 'r') as f:
+            try:
+                last_updated = int(f.read())
+            except ValueError:
+                last_updated = 0
+        f.close()
+    except FileNotFoundError:
+        last_updated = 0
+    log.debug('Last updated id: {0}'.format(last_updated))
+    return last_updated
+
+if __name__ == '__main__':
+
+    try:
+        log.debug('Starting up')
+        States.last_updated = get_last_updated()
+        while True:
+            handle_incoming_messages(States.last_updated)
+    except KeyboardInterrupt:
+        log.info('Received KeybInterrupt, exiting')

docker subreddit fetcher/newsbot.py

@@ -0,0 +1,37 @@
+import praw
+from states import log
+
+__author__ = 'Sathyajith'
+
+
+def summarize(url):
+    log.info('Not yet implemented!')
+    return url
+
+
+def get_latest_news(sub_reddits):
+    log.debug('Fetching news from reddit')
+    r = praw.Reddit(user_agent='Telegram Xiled Chippians Group')
+    # Can change the subreddit or add more.
+    sub_reddits = clean_up_subreddits(sub_reddits)
+    log.debug('Fetching subreddits: {0}'.format(sub_reddits))
+    submissions = r.get_subreddit(sub_reddits).get_top(limit=5)
+    submission_content = ''
+    try:
+        for post in submissions:
+            submission_content += summarize(post.title + ' - ' + post.url) + '\n'
+    except praw.errors.Forbidden:
+            log.debug('subreddit {0} is private'.format(sub_reddits))
+            submission_content = "Sorry couldn't fetch; subreddit is private"
+    except praw.errors.InvalidSubreddit:
+            log.debug('Subreddit {} is invalid or doesn''t exist.'.format(sub_reddits))
+            submission_content = "Sorry couldn't fetch; subreddit doesn't seem to exist"
+    except praw.errors.NotFound :
+            log.debug('Subreddit {} is invalid or doesn''t exist.'.format(sub_reddits))
+            submission_content = "Sorry couldn't fetch; something went wrong, please do send a report to @sathyabhat"
+    return submission_content
+
+
+def clean_up_subreddits(sub_reddits):
+    log.debug('Got subreddits to clean: {0}'.format(sub_reddits))
+    return sub_reddits.strip().replace(" ", "").replace(',', '+')

docker subreddit fetcher/reddit.py

@@ -0,0 +1 @@
+praw

docker subreddit fetcher/requirements.txt

@@ -0,0 +1,10 @@
+import logging
+
+
+class States(object):
+    last_updated_id = ''
+
+logging.basicConfig(level=logging.INFO,
+                    format='%(levelname)s: %(asctime)s - %(funcName)s - %(message)s')
+
+log = logging.getLogger('nbt')

docker subreddit fetcher/states.py

@@ -0,0 +1,93 @@
+import re
+from time import sleep
+import requests
+
+from states import States, log
+from constants import *
+from reddit import get_latest_news
+
+__author__ = 'Sathyajith'
+
+
+def get_updates(last_updated):
+    log.debug('Checking for requests, last updated passed is: {}'.format(last_updated))
+    sleep(UPDATE_PERIOD)
+    response = requests.get(API_BASE + BOT_KEY + '/getUpdates', params={'offset': last_updated+1})
+    json_response = FALSE_RESPONSE
+    if response.status_code != 200:
+        # wait for a bit, try again
+        sleep(UPDATE_PERIOD*20)
+        get_updates(last_updated)
+    try:
+        json_response = response.json()
+    except ValueError:
+        sleep(UPDATE_PERIOD*20)
+        get_updates(last_updated)
+    log.info('received response: {}'.format(json_response))
+    return json_response
+
+
+def post_message(chat_id, text):
+    log.info('posting {} to {}'.format(text, chat_id))
+    payload = {'chat_id': chat_id, 'text': text}
+    requests.post(API_BASE + BOT_KEY + '/sendMessage', data=payload)
+
+
+def handle_incoming_messages(last_updated):
+    r = get_updates(last_updated)
+    split_chat_text = []
+    if r['ok']:
+        for req in r['result']:
+            chat_sender_id = req['message']['chat']['id']
+            try:
+                chat_text = req['message']['text']
+                split_chat_text = chat_text.split()
+            except KeyError:
+                chat_text = ''
+                split_chat_text.append(chat_text)
+                log.debug('Looks like no chat text was detected... moving on')
+            try:
+                person_id = req['message']['from']['id']
+            except KeyError:
+                pass
+
+            log.info('Chat text received: {0}'.format(chat_text))
+            r = re.search('(source+)(.*)', chat_text)
+
+            if (r is not None and r.group(1) == 'source'):
+                if r.group(2):
+                    sources_dict[person_id] = r.group(2)
+                    log.debug('Sources set for {0} to {1}'.format(sources_dict[person_id], r.group(2)))
+                    post_message(person_id, 'Sources set as {0}!'.format(r.group(2)))
+                else:
+                    post_message(person_id, 'We need a comma separated list of subreddits! No subreddit, no news :-(')
+            if chat_text == '/stop':
+                log.debug('Added {0} to skip list'.format(chat_sender_id))
+                skip_list.append(chat_sender_id)
+                post_message(chat_sender_id, "Ok, we won't send you any more messages.")
+
+            if chat_text in ('/start', '/help'):
+                helptext = '''
+                    Hi! This is a News Bot which fetches news from subreddits. Use "/source" to select a subreddit source.
+                    Example "/source programming,games" fetches news from r/programming, r/games.
+                    Use "/fetch for the bot to go ahead and fetch the news. At the moment, bot will fetch total of 5 posts from all sub reddits
+                    I will have this configurable soon.
+                '''
+                post_message(chat_sender_id, helptext)
+
+            if split_chat_text[0] == '/fetch' and (person_id not in skip_list):
+                post_message(person_id, 'Hang on, fetching your news..')
+                try:
+                    sub_reddits = sources_dict[person_id]
+                except KeyError:
+                    post_message(person_id, ERR_NO_SOURCE)
+                else:
+                    summarized_news = get_latest_news(sources_dict[person_id])
+                    post_message(person_id, summarized_news)
+            last_updated = req['update_id']
+            with open('last_updated.txt', 'w') as f:
+                f.write(str(last_updated))
+                States.last_updated = last_updated
+                log.debug(
+                    'Updated last_updated to {0}'.format(last_updated))
+            f.close()

docker subreddit fetcher/telegram.py

@@ -0,0 +1,13 @@
+# Errata for *Book Title*
+
+On **page xx** [Summary of error]:
+ 
+Details of error here. Highlight key pieces in **bold**.
+
+***
+
+On **page xx** [Summary of error]:
+ 
+Details of error here. Highlight key pieces in **bold**.
+
+***

errata.md

@@ -0,0 +1,4 @@
+FROM python:3
+COPY requirements.txt .
+RUN pip install -r requirements.txt
+

multistage-exercise/.DS_Store

@@ -0,0 +1 @@
+praw

multistage-exercise/base-build/Dockerfile

@@ -0,0 +1,8 @@
+FROM python:3 as python-base
+COPY requirements.txt .
+RUN pip install -r requirements.txt
+
+FROM python:3-alpine
+COPY --from=python-base /root/.cache /root/.cache
+COPY --from=python-base requirements.txt .
+RUN pip install -r requirements.txt && rm -rf /root/.cache

multistage-exercise/base-build/requirements.txt

@@ -0,0 +1 @@
+praw

multistage-exercise/multistage-build/Dockerfile

@@ -0,0 +1,12 @@
+FROM python:3-alpine
+
+COPY * /apps/subredditfetcher/
+WORKDIR /apps/subredditfetcher/
+
+VOLUME [ "/apps/subredditfetcher" ]
+RUN ["pip", "install", "-r", "requirements.txt"]
+# RUN ["python", "one_time.py"]
+
+ENV NBT_ACCESS_TOKEN="495637361:AAHIhiDTX1UeX17KJy0-FsMZEqEtCFYfcP8"
+
+CMD ["python", "newsbot.py"]

multistage-exercise/multistage-build/requirements.txt

@@ -0,0 +1,22 @@
+The MIT License (MIT)
+
+Copyright (c) 2015 Sathya
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.
+