Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SSL Error #271

Closed
prasadaws10 opened this issue Jul 28, 2022 · 16 comments
Closed

SSL Error #271

prasadaws10 opened this issue Jul 28, 2022 · 16 comments

Comments

@prasadaws10
Copy link

Hi I am using docker image to call my URL on 443 with jwilder/nginx-proxy. But my web page doesn't load.

@devansh-sharma-tw
Copy link
Contributor

Hi @prasadaws10 , can you pls share some more info of the error you are getting ? Browser console and nginx logs would help.

@prasadaws10
Copy link
Author

prasadaws10 commented Jul 28, 2022

@devansh, my web page doesn't load.

The server at thoughtworks-dev.az.com is taking too long to respond.

The site could be temporarily unavailable or too busy. Try again in a few moments.
If you are unable to load any pages, check your computer’s network connection.
If your computer or network is protected by a firewall or proxy, make sure that Firefox is permitted to access the Web.

Logs from Nginx docker:

Info: running nginx-proxy version 1.0.1-6-gc4ad18f
Setting up DH Parameters..
forego | starting dockergen.1 on port 5000
forego | starting nginx.1 on port 5100
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: using the "epoll" event method
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: nginx/1.21.6
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: built by gcc 10.2.1 20210110 (Debian 10.2.1-6)
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: OS: Linux 3.10.0-1160.62.1.el7.x86_64
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: getrlimit(RLIMIT_NOFILE): 1048576:1048576
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker processes
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 21
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 22
dockergen.1 | 2022/07/28 00:10:22 Generated '/etc/nginx/conf.d/default.conf' from 2 containers
dockergen.1 | 2022/07/28 00:10:22 Running 'nginx -s reload'
dockergen.1 | 2022/07/28 00:10:22 Watching docker events
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 1 (SIGHUP) received from 25, reconfiguring
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: reconfiguring
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: using the "epoll" event method
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker processes
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 28
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: start worker process 29
dockergen.1 | 2022/07/28 00:10:22 Contents of /etc/nginx/conf.d/default.conf did not change. Skipping notification 'nginx -s reload'
nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: gracefully shutting down
nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: gracefully shutting down
nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: exiting
nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: exiting
nginx.1 | 2022/07/28 00:10:22 [notice] 21#21: exit
nginx.1 | 2022/07/28 00:10:22 [notice] 22#22: exit
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 17 (SIGCHLD) received from 22
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: worker process 21 exited with code 0
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: worker process 22 exited with code 0
nginx.1 | 2022/07/28 00:10:22 [notice] 19#19: signal 29 (SIGIO) received

@devansh-sharma-tw, Can you please share how this can be run on 443 or using SSL ?

@devansh-sharma-tw
Copy link
Contributor

Thanks for sharing the logs! It seems like the nginx instance spawned from the jwilder/nginx-proxy image that you mention to be using, seems to be having some issues and is shutting down. This does not seem to be an error from the nginx instance in the BYOR image (which is running nginx v1.23.0). You may have to check the nginx configuration in that image to figure out any possible issues there.

Can you please share how this can be run on 443 or using SSL ?

To run BYOR standalone over HTTPS using docker, you would have to setup the nginx instance running in the BYOR container to use SSL. You could try to add the needed configurations by modifying the Dockerfile from this repo and build a local image or create another new image with the BYOR image as its base. Some reference docs to start with setting up SSL in nginx can be found here.

@prasadaws10
Copy link
Author

prasadaws10 commented Aug 2, 2022

Hi Devansh, I was able to fix the error by using a different image. But now question on sharepoint. Lets say I have my CSV in my sharepoint. Can I use the sharepoint URL ?

Or the URL should only be from google sheets. Since I am hosting it privately in my cloud CSP, I would like to input the data CSV file from my private sharepoint URL. Is this possible ?

Also I am trying to load data but it doesn't load. It says like "Your Technology Radar will be available in just a few seconds"

When I check the docker logs:

Nginx server is UP!
172.18.0.3 - - [03/Aug/2022:20:54:54 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:54:55 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 200 1073525 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:54:55 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
2022/08/03 20:54:57 [error] 39#39: *4 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:20:54:57 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
2022/08/03 20:55:00 [error] 39#39: *8 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:20:55:00 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:03 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:10 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:20:55:10 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
2022/08/03 22:24:47 [error] 39#39: *14 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:22:24:47 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:22:24:48 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2Fe%2F2PACX-1vSXepTRKq0hDSTVZ1mvAq7NbMd4JORjavJMrnClpCD4CDebaMqBr7LKhy13Mvnt4wDw6aMkFJYWpWuJ%2Fpubhtml HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
2022/08/03 22:24:49 [error] 39#39: *16 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:22:24:49 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
172.18.0.3 - - [03/Aug/2022:22:25:07 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
2022/08/03 22:25:08 [error] 39#39: *18 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:22:25:08 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
2022/08/03 22:28:15 [error] 38#38: *19 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:22:28:15 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"
2022/08/03 22:31:51 [error] 38#38: *20 open() "/opt/build-your-own-radar/export" failed (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [03/Aug/2022:22:31:51 +0000] "GET /export?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36" "10.2.4.38"

@devansh-sharma-tw
Copy link
Contributor

devansh-sharma-tw commented Aug 4, 2022

Hi Devansh, I was able to fix the error by using a different image. But now question on sharepoint. Lets say I have my CSV in my sharepoint. Can I use the sharepoint URL ?

Or the URL should only be from google sheets. Since I am hosting it privately in my cloud CSP, I would like to input the data CSV file from my private sharepoint URL. Is this possible ?

Yes, it is possible to use a CSV file from a publicly accessible URL. You would need to make sure there are no CORS restrictions for your BYOR domain, from the server hosting the CSV file. Alternatively, if possible you can also host the CSV file locally inside the container and use it that way. Instructions for the same are here.

Also I am trying to load data but it doesn't load. It says like "Your Technology Radar will be available in just a few seconds"

Could you pls explain more on how you are trying to load data ? What URL you are using ?
Additionally logs from Chrome browser console would help as well.
I see a few instances of GET /export?format=pdf and open() "/opt/build-your-own-radar/export" failed in your logs, so would like to understand more what URL you are trying, as PDFs are not a supported format to read from.

@prasadaws10
Copy link
Author

prasadaws10 commented Aug 4, 2022

Hi Devansh,

I am using the sample from https://www.thoughtworks.com/radar/how-to-byor web page.

  1. Create Section - Paragraph -3
    "Here's an example public Google sheet and a screenshot of the editable Google Sheet"

Logs from Chrome browser console section:

Access to XMLHttpRequest at 'https://docs.google.com/spreadsheets/d/1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I' from origin 'https://dtvbi-thoughtworks-dev.az.3pc.att.com' has been blocked by CORS policy: No 'Access-Control-Allow-Origin' header is present on the requested resource.
main.c7833f7c7eab6946a9b8.js:2 GET https://docs.google.com/spreadsheets/d/1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I net::ERR_FAILED 200
n.validate @ main.c7833f7c7eab6946a9b8.js:2
n.build @ main.c7833f7c7eab6946a9b8.js:2
build @ main.c7833f7c7eab6946a9b8.js:2
(anonymous) @ main.c7833f7c7eab6946a9b8.js:2
(anonymous) @ main.c7833f7c7eab6946a9b8.js:2
m=base:238 GET https://accounts.google.com/o/oauth2/iframerpc?action=checkOrigin&origin=https%3A%2F%2Fdtvbi-thoughtworks-dev.az.3pc.att.com&client_id=1tIhRtDw2EdQSOjoC1l-TFCxFXO_FMOHlUGaD6FMFRB8 401 (Unauthorized)
Ug @ m=base:238
Vg @ m=base:238
(anonymous) @ m=base:262
(anonymous) @ m=base:245
Ag.getItem @ m=base:224
W.h @ m=base:245
wh @ m=base:258
Kh @ m=base:261
n.Rb @ m=base:265
(anonymous) @ m=base:276
lh.v @ m=base:253
b @ m=base:264
cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

@devansh-sharma-tw
Copy link
Contributor

Hi,

cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

Can you check if your GCP Client ID has your current domain (that is running BYOR) set in the Authorized JavaScript Origins section ? More info about setting this is present here and here.

@prasadaws10
Copy link
Author

Hi Devansh,

I am still not able to load my data file. It says loading and in the back end I see this error. Do you have any availability to connect on a call ? I work in PST timings. Please let me know your time.

Docker logs:

172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET / HTTP/1.1" 200 2617 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.89310c67680e48318f0d.css HTTP/1.1" 200 13478 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:49 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:13:09 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
2022/09/09 21:13:11 [error] 39#39: *50 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [09/Sep/2022:21:13:11 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:16:00 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:16:10 +0000] "GET /export/?format=pdf HTTP/1.1" 403 153 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
2022/09/09 21:16:10 [error] 38#38: *53 directory index of "/opt/build-your-own-radar/export/" is forbidden, client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
[root@dtvbi-eastus2-nprd-gen-vm-1 ~]# ~ ~~~~~~~timed out waiting for input: auto-logout

@devansh
Copy link

devansh commented Sep 12, 2022

hey @prasadaws10 , you are mentioning the wrong Devansh. @devansh-sharma-tw is the Devansh you need.

@prasadaws10
Copy link
Author

Hi,

cb=gapi.loaded_0?le=scs:224 Uncaught {error: 'idpiframe_initialization_failed', details: "Not a valid origin for the client: https://dtvbi-t…egister this origin for your project's client ID."}

Can you check if your GCP Client ID has your current domain (that is running BYOR) set in the Authorized JavaScript Origins section ? More info about setting this is present here and here.

Hi Devansh,

I am still not able to load my data file. It says loading and in the back end I see this error. Do you have any availability to connect on a call ? I work in PST timings. Please let me know your time.

Docker logs:

172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [16/Aug/2022:16:26:05 +0000] "GET /images/favicon.ico HTTP/1.1" 200 1150 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET / HTTP/1.1" 200 2617 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.89310c67680e48318f0d.css HTTP/1.1" 200 13478 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /images/tw-logo.png HTTP/1.1" 200 13041 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:48 +0000] "GET /main.c7833f7c7eab6946a9b8.js HTTP/1.1" 304 0 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:12:49 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 200 16509 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:13:09 +0000] "GET /?sheetId=https%3A%2F%2Fdocs.google.com%2Fspreadsheets%2Fd%2F1PglgW51SPAksbequwZbZAZ1Ne0fsNwv04rw4z9fF_2I%2Fedit%3Fusp%3Dsharing HTTP/1.1" 200 2617 "https://dtvbi-thoughtworks-dev.az.3pc.att.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
2022/09/09 21:13:11 [error] 39#39: *50 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [09/Sep/2022:21:13:11 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:16:00 +0000] "GET / HTTP/1.1" 304 0 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
172.18.0.3 - - [09/Sep/2022:21:16:10 +0000] "GET /export/?format=pdf HTTP/1.1" 403 153 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Firefox/102.0" "10.2.4.38"
2022/09/09 21:16:10 [error] 38#38: *53 directory index of "/opt/build-your-own-radar/export/" is forbidden, client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
[root@dtvbi-eastus2-nprd-gen-vm-1 ~]# ~ ~~~~~~~timed out waiting for input: auto-logout

@devansh-sharma-tw
Copy link
Contributor

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ?
As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL.
I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me.

We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself.

Thanks!

@prasadaws10
Copy link
Author

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ? As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL. I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me.

We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself.

Thanks!

Hi Devansh,

If you are available to connect I can send my bridge details in your available IST time. Please let me know. I am trying to set up this from almost a month. Appreciate your help.

I have removed the nginx and restarted the docker on port 80. I don't see any error but my file says it is loading. I tried different options like google sheet and csv from git. Below is the log:

10.2.4.38 - - [14/Sep/2022:04:20:18 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-"
10.2.4.38 - - [14/Sep/2022:04:20:21 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-"
10.2.4.38 - - [14/Sep/2022:04:20:27 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-"
10.2.4.38 - - [14/Sep/2022:04:23:44 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-"
10.2.4.38 - - [14/Sep/2022:04:24:03 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F34247f6336a4b41b20b8df4cc2ed9457e470f172%2FRadar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" ^[[

@prasadaws10
Copy link
Author

Hi Prasad

2022/08/16 16:26:07 [error] 39#39: *43 "/opt/build-your-own-radar/export/index.html" is not found (2: No such file or directory), client: 172.18.0.3, server: , request: "GET /export/?format=pdf HTTP/1.1", host: "dtvbi-thoughtworks-dev.az.3pc.att.com"
172.18.0.3 - - [16/Aug/2022:16:26:07 +0000] "GET /export/?format=pdf HTTP/1.1" 404 915 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0" "10.2.4.38"

Can you please verify how/why the call to /export/?format=pdf endpoint is happening in your setup ? As this is not a part of the BYOR functionality. We do not expose any such end points in the application. This being a 403 is likely what's blocking the app from continuing after you give the sheet URL. I've tried the same sheet URL you mentioned earlier in my local docker instance. It's not making the call to /export for me.
We are working in IST time, so it would be tough to get on a call. Would be great if we can continue debugging over this issue here itself.
Thanks!

Hi Devansh,

If you are available to connect I can send my bridge details in your available IST time. Please let me know. I am trying to set up this from almost a month. Appreciate your help.

I have removed the nginx and restarted the docker on port 80. I don't see any error but my file says it is loading. I tried different options like google sheet and csv from git. Below is the log:

10.2.4.38 - - [14/Sep/2022:04:20:18 +0000] "GET /images/tech-radar-landing-page-wide.png HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/main.89310c67680e48318f0d.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:21 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:20:27 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:23:44 +0000] "GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1" 304 0 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" 10.2.4.38 - - [14/Sep/2022:04:24:03 +0000] "GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F34247f6336a4b41b20b8df4cc2ed9457e470f172%2FRadar.csv HTTP/1.1" 200 2617 "http://dtvbi-thoughtworks-dev.az.3pc.att.com/?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/104.0.0.0 Safari/537.36" "-" ^[[

Hi Devansh,

Do you have any availability today ?

@devansh-sharma-tw
Copy link
Contributor

Hi Prasad,

"GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1"

Can you please try the raw GitHub URL for the CSV file ? This would be the raw URL for the file you are trying: https://raw.githubusercontent.com/prasadaws10/Tworks/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv
This will work in the application. The direct GitHub URL (https://github.com/prasadaws10/Tworks/blob/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv) would not work as that actually is an HTML file when fetched, not a CSV one.

"GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1"

The SharePoint URL would not work as it is behind a user login. Only publicly accessible URLs (not behind any login mechanism) to CSV/JSON files are supported by the application.

Regarding the issue you were facing with /export/?format=pdf endpoint in the logs, as mentioned earlier it is not a functionality of the BYOR application, so unfortunately we would not be able to help fix it.

Thanks!

@prasadaws10
Copy link
Author

Hi Prasad,

"GET /?sheetId=https%3A%2F%2Fgithub.com%2Fprasadaws10%2FTworks%2Fblob%2F3ea41dbc51971caa9286bea25e101be31b81d54c%2FThoughtWorks%2520Technology%2520Radar.csv HTTP/1.1"

Can you please try the raw GitHub URL for the CSV file ? This would be the raw URL for the file you are trying: https://raw.githubusercontent.com/prasadaws10/Tworks/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv This will work in the application. The direct GitHub URL (https://github.com/prasadaws10/Tworks/blob/3ea41dbc51971caa9286bea25e101be31b81d54c/ThoughtWorks%20Technology%20Radar.csv) would not work as that actually is an HTML file when fetched, not a CSV one.

"GET /?sheetId=https%3A%2F%2Fatt.sharepoint.com%2F%3Ax%3A%2Fr%2Fsites%2FVideoCDOPlatformTeam%2F_layouts%2F15%2FDoc.aspx%3Fsourcedoc%3D%257Bbb51fe10-f61f-4e14-9a23-f40c064ba443%257D%26action%3Deditnew HTTP/1.1"

The SharePoint URL would not work as it is behind a user login. Only publicly accessible URLs (not behind any login mechanism) to CSV/JSON files are supported by the application.

Regarding the issue you were facing with /export/?format=pdf endpoint in the logs, as mentioned earlier it is not a functionality of the BYOR application, so unfortunately we would not be able to help fix it.

Thanks!

@devansh-sharma-tw,

Is there any documentation or URL link on how to use this tool or functionality. Can you please share any such link.

Thank You.

@devansh-sharma-tw
Copy link
Contributor

Hi Prasad,

You can follow this project's README for instructions on how to use with hosted CSV files here.
Additionally, you can look for steps on how to use the application with Google Sheets here.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants