-
Notifications
You must be signed in to change notification settings - Fork 7
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
start on negative valence update #302
Conversation
…core PV DA method at start in ApplyPVLV.. CS da updates online. VSPatch learns from prev senders.
…al vars so results accessible from GPU). added gain factors, etc.
…overall -- add a SetNUSs method
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's quite a bit of changes. It would be good to go over them in person.
Still a work in progress - should be working soon - can go over on weds |
…PU / GPU; clip DA GGain in NeuroMod so it doesn't get negative (fixes FloatFromInt errors finally!); other cleanup. Now actually minimally working in PVLV.
…erall flags, and PVLV uses them at next trial start to update maxes etc.
…in pvlv looks reasonable.
… drive ACh and gating (need to test); don't use vspatch from a prior reward trial (fixes give up in boa). still need to figure out timing of lhb dip sum vs. pvda etc.
…ing for HasRew even if negative! that almost certainly affected give up. need better testing.
…dded Time in addition to Effort; minimally working but params need adjusting
…nd needs urgency but it isn't quite working right.
…erences via GiBase, and RLRate uses Sigmoid to prevent saturation, SpkPrv based only on GeIntNorm
…offsets right -- now pvlv NegAcq working again..
…n the Makefile -- all updated now
Codecov ReportPatch coverage:
Additional details and impacted files@@ Coverage Diff @@
## master #302 +/- ##
==========================================
- Coverage 29.88% 29.45% -0.44%
==========================================
Files 85 90 +5
Lines 15524 16003 +479
==========================================
+ Hits 4639 4713 +74
- Misses 10623 11016 +393
- Partials 262 274 +12
☔ View full report in Codecov by Sentry. |
@etuleu this is ready to try out on obelisk boa etc -- more testing to be done but should be good enough to start exploring. |
…s whether it can build; added build_exe target that makes the exe, and remake them for params_good to be sure; updated VSPatch param defaults to match, removing spurious diffs
@etuleu here's a start on what we sketched out..