Where does the reporting happen? #626
Replies: 36 comments 53 replies
-
|
How can we test whether the playback history is being recorded or not? I am willing to fix this issue for librespot-java, but I need a way to test it properly. |
Beta Was this translation helpful? Give feedback.
-
|
That's a good point and something I'll try to do: you can get the recently played tracks using the web API (the call is still beta... hopefully that won't confuse even more...). https://developer.spotify.com/documentation/web-api/reference/player/get-recently-played/ |
Beta Was this translation helpful? Give feedback.
-
|
@michaelherger I've checked and it seems that tracks played from librespot aren't reported by that endpoint. I will investigate this further. |
Beta Was this translation helpful? Give feedback.
-
|
Thanks for the confirmation! |
Beta Was this translation helpful? Give feedback.
-
|
Unluckily I don't see any specific call to report that a track is playing. I am afraid that it is done via the There's no reporting in the HTTP API either. Android doesn't seem to have any of this either. I've also noticed that the Recently played API updates quite slowly, so maybe librespot-java works with reporting? Don't know. |
Beta Was this translation helpful? Give feedback.
-
|
@devgianlu There is also an |
Beta Was this translation helpful? Give feedback.
-
I did not see any of that. Maybe it has been deprecated when they upgraded the protocol. |
Beta Was this translation helpful? Give feedback.
-
|
This was from an older version indeed. I need to find my notes. |
Beta Was this translation helpful? Give feedback.
-
|
I think that's for episodes only. |
Beta Was this translation helpful? Give feedback.
-
|
You are probably right again, its been a while I looked at this! |
Beta Was this translation helpful? Give feedback.
-
|
Any updates on this? |
Beta Was this translation helpful? Give feedback.
-
|
We are stuck on trying to find a way to check if the changes on the client work. |
Beta Was this translation helpful? Give feedback.
-
|
It’s probably handled via the events service. I’d be surprised if Spotify does the play reporting client side, would make it too easy to abuse. Then again, I can’t see how they track it server side unless they’re doing some sort of calculation based on the number of chunks sent to a client |
Beta Was this translation helpful? Give feedback.
-
|
I was thinking about this some time back, and I guess they probably have metrics based on client type, and since we report |
Beta Was this translation helpful? Give feedback.
-
|
Just a quick question on the topic. Do you think it is better to send an event with some standard values that I didn't figure out or just not send it because it is not needed? |
Beta Was this translation helpful? Give feedback.
-
|
its better to send them if they are generated to behave like a original client. |
Beta Was this translation helpful? Give feedback.
-
What do you mean? |
Beta Was this translation helpful? Give feedback.
-
|
does librespot now sends correctly the playing track to the endpoint? because it seems like that still hearing a song, does not appearing to the endpoint of the artist |
Beta Was this translation helpful? Give feedback.
-
|
No, only |
Beta Was this translation helpful? Give feedback.
-
|
im using librespot-java and there is still something not working regarding that endpoint. listening to a song does not appear on the artist site as someone is listening. What exactly does work now, and what not? Does it only work if a song without pressing any button like above mentioned (only via trackdone) is listened, that the endpoint get the information about trackdone? |
Beta Was this translation helpful? Give feedback.
-
|
Hi - as I'd really appreciate if streaming through librespot gets credited to the artists - is it possible to get the partial solution from librespot-java implemented in the main librespot branch - possibly also find a solution to the limitations of the current fix. I don't like artists getting "cheated" out of the royalties for streaming. |
Beta Was this translation helpful? Give feedback.
-
|
In |
Beta Was this translation helpful? Give feedback.
-
|
@Johannesd3 Edit: Hmm, from Spotify's Docs downloaded plays are included that we do not report. |
Beta Was this translation helpful? Give feedback.
-
I have no way of knowing or testing - I started to suspect something was odd when I noticed that my "Spotify year in review" was way off "Last.fm year summary" - then I found this thread. I've talked to an artist I know - and he had a retired band called Monumentum witch receive less than 10 streams a day for this track (Whore): https://open.spotify.com/track/5scAew6okD9CUIwumeswc6?si=KqYqb1NxQH2ey594c3YHgg If more people test some streams each through Librespot - I will report back if the stats is updated with a significant change in a couple of days. (Please don't use official apps 😅)
|
Beta Was this translation helpful? Give feedback.
-
I think many of the questions here already have been answered towards the top of this discussion. The simplest indication is that what you play wouldn't show up in your play history. My Weekly Discovery or similar playlist has nothing to do with what I actually listen to... I've worked with close to a dozen streaming services over the years. And it's not unusual to have the reporting implemented on the client. Most services would give the client a URL to play, but leave the control to the implementation. Whether the stream was played or not, only the client application knows. And, as has been mentioned here today, even for Spotify there must be something like that, as the offline mode would not allow Spotify to see what has been played while offline. Keep in mind that this is not "being naive", but part of a contract between the services and the developer of a client: either the reporting is implemented correctly, or you (as a developer) get blocked. librespot is different in this regard, as there's no contract, but things have been reverse engineered. And it's my understanding that the development of librespot always tried to play fair. |
Beta Was this translation helpful? Give feedback.
-
|
Using librespot-java I don't seem to have this problem. My personal playlists make sense and my yearly summary had quite a lot of artists listened to, too many to be coming from my phone alone. I haven't checked in a while, but songs appear in the recently played API endpoint too. The only thing that was broken at the time was skipping a track. |
Beta Was this translation helpful? Give feedback.
-
|
Btw, what happens if a downloaded track is played offline in the official client? Does that appear on the artist site? |
Beta Was this translation helpful? Give feedback.
-
|
It will probably be reported when the client goes back online. The same happens when you close the client, the last played song events are sent on the next startup. |
Beta Was this translation helpful? Give feedback.
-
|
it does report when you go online |
Beta Was this translation helpful? Give feedback.
-
|
Checking to see if "reporting" has made any progress. Would be good to make sure artists get the (small) sum they are due and there are other feature requests from at least one downstream client which may be related (i.e. last.fm reporting). |
Beta Was this translation helpful? Give feedback.
-
|
I totally agree and porting it from |
Beta Was this translation helpful? Give feedback.
-
|
It's honestly baffling that Spotify's API is this lacking. |
Beta Was this translation helpful? Give feedback.
-
|
I’m not sure if it’s lacking, it’s just that we haven’t fully figured it out yet. |
Beta Was this translation helpful? Give feedback.
-
|
can just tell that |
Beta Was this translation helpful? Give feedback.
-
|
No, I haven't gotten around to porting it yet. Also it'll be what's in |
Beta Was this translation helpful? Give feedback.
-
|
It would be great if this was implemented. Spotify would probably try to curb librespot if it was reporting back playcounts - so I can understand why it hasn't been added yet. As it stands, using this project to |
Beta Was this translation helpful? Give feedback.
-
|
I believe reporting should be implemented if possible. Lack of reporting can be reason enough for Spotify to kill the project. There really is no reason not to do it - except for the lack of documentation, time and resources of course 😁. I like the fact how the librespot project has continuously (tried to) shut down or stop illegal use of the code (eg. music file downloaders). It has been working hard to be a good citizen in the Spotify landscape. Implementing the reporting would only be in line with this stance. |
Beta Was this translation helpful? Give feedback.
-
|
I can supply access to artist account that has no previous traffic if that would help with testing. |
Beta Was this translation helpful? Give feedback.
-
If you kill an entirely reverse engineered project for not reverse engineering a particular part of your private system then I think you're just looking for a reason to kill the project, because that's a ridiculous stance. I'm not sure this reason not to implement it actually matters but it is something to think carefully about and implement carefully. Fortunately it's moot until someone works out how to do it! Edit: here's some context https://ppcprotect.com/blog/ad-fraud/spotify-streaming-farms/ |
Beta Was this translation helpful? Give feedback.
-
|
Also regardless of the legal complexities, reverse engineering reporting and reproducing the functionality 1-1 is all we should be aiming to do - preventing potential fraud is not really within the scope of librespot, and anyone using librespot provides Spotify with all the identifying information that they need to be able to counter fake plays if they want to. It's not our problem to deal with. |
Beta Was this translation helpful? Give feedback.
-
|
Great discussion everyone, thanks.
No-one except Spotify knows for certain of course. Technically I wonder if it'd be different depending on the handshake. We don't authenticate as Since clients can play tracks offline, I guess that they would buffer playback history locally and report all that on connection. Again this is a total guess (I haven't looked at the traffic yet) but if so, that would be another nudge towards client-based reporting instead of server-based reporting.
Is that the same thing? I can attest that when you have
Amen to that. |
Beta Was this translation helpful? Give feedback.
-
|
Hi, I'm curious about the status of the reporting back to Spotify of a played track. Is this still an issue or has it been fixed somewhere else? Thanks |
Beta Was this translation helpful? Give feedback.
-
|
Still not implemented. |
Beta Was this translation helpful? Give feedback.
-
|
Is this likely to ever be implemented? Especially with the rise of apps like stats.fm, as the lack of reporting breaks the app. The mentioned app/site is however a good way to test the reporting functionality. |
Beta Was this translation helpful? Give feedback.
-
|
It will require someone to put the legwork in to reverse and implement it. The thus far unspoken challenge is that without it artists are missing out on a few fractions of a cent, and with it implemented someone may potentially try to cheat. |
Beta Was this translation helpful? Give feedback.
-
|
Librespot-Java has got parts figured out. I just did not get around to porting it. |
Beta Was this translation helpful? Give feedback.
-
|
Looks like librespot-java isn't working in this regard now though |
Beta Was this translation helpful? Give feedback.
-
|
although, my own tests seem to show that the issue isn't reproducible. |
Beta Was this translation helpful? Give feedback.
-
|
Perhaps an interesting method of achieving this feature would be analysing how the client stores then reports offline listens once connection is reestablished. It would probably be easier to get this right, but would make live listen information (think discord now playing etc). |
Beta Was this translation helpful? Give feedback.
-
|
I seem pretty late to the party, so apologies if someone has already figured this out. But I haven't seen anyone mention this yet so here's my two cents: {
"seq_num": 17,
"state_ref": {
"state_machine_id": "<id>",
"state_id": "<id>",
"paused": false
},
"sub_state": {
"playback_speed": 1,
"position": 0,
"duration": 158656,
"media_type": "AUDIO",
"bitrate": 256000,
"audio_quality": "VERY_HIGH",
"format": 11
},
"previous_position": 173930,
"debug_source": "before_track_load"
}Edit: for reference, ALL fields are required. |
Beta Was this translation helpful? Give feedback.
-
|
I don't use librespot because I'm concerned artists don't get their cut with it. It's a bit of a pick your poison situation there. Songs used to show up in history with Spotifyd before the credentials change. |
Beta Was this translation helpful? Give feedback.
-
I'd say that if people wanted to use the reporting API for malice they would do it anyway. "Hurting" genuine users just because some malicious users might do something bad with the code seems like bad trade-off IMO. |
Beta Was this translation helpful? Give feedback.
-
It's hurting genuine artists, that doesn't get credited for listening through librespot - this "tradeoff" benefits very few, and hurt everyone. |
Beta Was this translation helpful? Give feedback.
-
I'm confused by what you are saying here. People already do abuse Spotify's client like this and they work to prevent it. There are checks and limits, presumably both client and server side. The reporting API we provide here would have none of their client-side checks and we couldn't hope to replicate them because we don't know them, and it's easy to disable anyway. Us providing it would make it trivial for low-life internet scum bags to exploit the reporting API and make money. The internet is full of these people. There are already those sorts of people avoiding the premium checks and ripping music. This project has nothing to do with those people or projects but they probably exist because of work originating here. If you want to support your artists, do it properly outside of Spotify. Spotify famously is terrible at this, the worst of all streaming providers. The idea you support your artists by using Spotify is fanciful. If you want to record your listening history with librespot, cook something up using the existing mechanisms or suggest a last.fm feature. If you want your librespot to contribute to your Spotify recommendations, that's something we can't do without the reporting API. But I don't think that's worth the abuse that will inevitably come as a result of providing this API. I'm not in charge here, I'm just a contributor but I value this project too much to have it ruined by this idea. |
Beta Was this translation helpful? Give feedback.
-
|
Personally I would like to have the reporting implementation, but we want to stay on the good side of spotify. So implementing it might tip our current balance in a wrong direction. Ideally would be a solution with which we can keep the reporting privately then integrate it in the main binary/library later on. But then again I currently can't think of any way of doing that in rust yet. |
Beta Was this translation helpful? Give feedback.
-
I've had a report of a user who happens to be an artist, too. He claims that when he's listening to his own music using my implementation of librespot, the tracks would not be reported. This is definitely not what I want to happen, therefore I'm a bit concerned.
And I must admit I've been wondering why my kids' listening habits hadn't polluted my profile yet... (but I was less concerned about that :-D).
Is there code in librespot which actively does report when a track has been listened to? I was assuming that telling librespot to play a track would do all the magic for me.
I'm using a slightly modified fork of librespot (https://github.com/michaelherger/librespot), and I'm not sure whether one of my modifications is causing this mis-behavior or not.
Beta Was this translation helpful? Give feedback.
All reactions