Commit Graph

67 Commits

Author SHA1 Message Date
5ccb06c545 V2.7 Normalized state
Normalized distance and rotation state.
2022-12-18 20:17:17 +09:00
64ada808de V2.6 change Ray Tag result as Onehot
change Ray Tag result as Onehot, 
Observation State:
-targetStates 6
-inTargetArea 1
-remainTime 1
-gunReady 1
-my Obs 4
-tag onehot 19*2
-tag dis 19
2022-12-10 10:14:44 +09:00
9b2ba7fb46 V2.5 Change reward function
Add chart Toggle to turn on reward chart real time in game.
Add enemy num changer, now can change enemy num in game.
Change facing to enemy reward function, while facing center line far from enemy will not get reward any more.
2022-12-10 09:11:42 +09:00
f9b806de02 V2.4 Add new reward function
add new reward function in attack mode
calculate distance between closest enemy and facing center line.
let agent could spawn in whole map area.
add penalty while mouseX is moving.
2022-12-08 06:27:49 +09:00
b2f80287d5 V2.3 Change State order
Change State order as
target state x6
in area state x1
remain time x1
gun state x1
my state x4
ray state ...
2022-12-08 06:27:49 +09:00
a0563646e3 V2.2 Fix Rotation State error
Fix Rotation State not unique error
2022-12-08 06:27:49 +09:00
74c85c4296 V2.1 Easier game!
Build-ParallelEnv-Target-OffPolicy-SingleStack-SideChannel-EndReward-Easy-V2.1
move remain time position after target state
easier game reward get, while watching or shoot at target area u get reward(attack mode), watching enemy u also get reward(Freemode)
2022-12-08 06:27:49 +09:00
fa90ac3bb6 V2.1 Add spin penalty and reward adjust
Build-ParallelEnv-Target-OffPolicy-SingleStack-SideChannel-EndReward-Easy-V2.1
add spin penalty while agent keep spin will give a penalty reward.
lower Go target in area reward.
2022-12-08 06:27:49 +09:00
0d60c857b7 V2.0 Bug Fix, scene added
fix scene only spawn in a small area in center.
delete room type attack target.
make no more enemy spawn in go target.
free mode enemy number change to 3.
2022-12-08 06:27:49 +09:00
8570a5ba5e bug fix
fix target attack always win in first round.
2022-12-01 19:52:52 +09:00
9585845ba2 Side channel Added
add side channel to let python side know which target got win or lose.
fix update time bug. may cause double gameover check.(got another lose after reset the game.)
2022-11-30 06:39:56 +09:00
25eac00c53 Target & dynamic reward System V1.0
太多了...总之能用了,就这样吧,也懒得用英文写了(;´Д`)
ParameterContainer用于管理所有的Reward和Parameter.
TargetController用于生成目标,然后再让SceneBlockContainer实际生成目标块,并且兼顾reward计算功能和目标观察结果的获取.
EnemyContainer用于生成和删除敌人.
SceneBlockContainer用于生成和删除目标块.

States用于管理HP.
SceneBlock用于管理目标块的...一堆东西,比如目标大小,目标区内人数等和目标所属状态等.
2022-11-29 07:54:08 +09:00
6e32da8b64 Add ParameterContainer
Add Parameter Container. make environment parameter adjustment easier.
2022-11-08 00:58:47 +09:00
b53612d3c6 In-game real time reward chart, free camera, result viewer and etc...
In-game real time reward chart, 
result viewer, 
free camera,
kill bonus reward(not so good. set 0 to unuse it)

Fix ray-sensor throw error when initialization issue.
Fix ray-sensor info panel face to wrong position.
2022-11-03 07:10:00 +09:00
ad547e4edb Parallel environment.
delete all unuse feature for Parallel environment.
it's possible to run each single environment independent
2022-10-26 16:20:27 +09:00
6bc1456e4b Fist Sub
based on aimbot multi seane
2022-10-26 04:07:39 +09:00
1fbaf9d540 Initial commit 2022-10-26 04:06:44 +09:00