Is PPO still applicable if the length of each trajectory is different? #1074

YingxiaoKong · 2020-03-22T03:47:35Z

New Issue Checklist

I have read the Contribution Guidelines
I searched for existing GitHub issues

Issue Description

[INSERT DESCRIPTION OF THE PROBLEM]

Reproducible Code

Which OS are you using ?
Please provide a reproducible code of your issue. Without any reproducible code, you will probably not receive any help.

[INSERT CODE HERE]

# ======================================================== #
###### THIS CODE IS AN EXAMPLE, REPLACE WITH YOUR OWN ######
# ======================================================== #

import tensorflow as tf
import tensorlayer as tl

x = tf.placeholder(tf.float32, [None, 64])
net_in = tl.layers.InputLayer(x)

net = tl.layers.DenseLayer(net_in, n_units=25, act=tf.nn.relu, name='relu1')

print("Output Shape:", net.outputs.get_shape().as_list()) ### Output Shape: [None, 25]

# ======================================================== #
###### THIS CODE IS AN EXAMPLE, REPLACE WITH YOUR OWN ######
# ======================================================== #

Hi in the paper I have read, they all said the trajectories should have the same length, or a 'fixed length'. I may misunderstand this meaning. But in all the codes I saw, they all make a fixed length for each episode. Can PPO still work if the length is different?

zsdonghao · 2020-03-23T15:17:18Z

Hi, I highly recommend TL2.0, so you can use the new RL code

YingxiaoKong · 2020-03-23T15:48:55Z

Thanks! I will have a look at it now!

…

________________________________ From: Hao <notifications@github.com> Sent: Monday, 23 March 2020 9:17 AM To: tensorlayer/tensorlayer <tensorlayer@noreply.github.com> Cc: Kong, Yingxiao <yingxiao.kong@vanderbilt.edu>; Author <author@noreply.github.com> Subject: Re: [tensorlayer/tensorlayer] Is PPO still applicable if the length of each trajectory is different? (#1074) Hi, I highly recommend TL2.0, so you can use the new RL code — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Ftensorlayer%2Ftensorlayer%2Fissues%2F1074%23issuecomment-602666816&data=02%7C01%7Cyingxiao.kong%40vanderbilt.edu%7C66d212053db4435b00ea08d7cf3d50aa%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C637205734559740779&sdata=7gqoxlR7mfKJrdvqNCV%2F8pKEikNQ7rBuO8kmAaU2XXA%3D&reserved=0>, or unsubscribe<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgithub.com%2Fnotifications%2Funsubscribe-auth%2FAIMGH4WHOF6LAOB7NCA7XEDRI54Q5ANCNFSM4LREWUZQ&data=02%7C01%7Cyingxiao.kong%40vanderbilt.edu%7C66d212053db4435b00ea08d7cf3d50aa%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C637205734559750777&sdata=9Y0TP6SPcpqseNYmWudDA3jrdpfcptAKdG7yQWBjsUk%3D&reserved=0>.

Oct	NOV	Dec
	29
2019	2020	2021

tensorlayer / tensorlayer

Is PPO still applicable if the length of each trajectory is different? #1074

Is PPO still applicable if the length of each trajectory is different? #1074

YingxiaoKong commented Mar 22, 2020 •

edited by quantumiracle

zsdonghao commented Mar 23, 2020

YingxiaoKong commented Mar 23, 2020

tensorlayer / tensorlayer

Join GitHub today

GitHub is where the world builds software

Is PPO still applicable if the length of each trajectory is different? #1074

Is PPO still applicable if the length of each trajectory is different? #1074

Comments

YingxiaoKong commented Mar 22, 2020 • edited by quantumiracle

New Issue Checklist

Issue Description

Reproducible Code

zsdonghao commented Mar 23, 2020

YingxiaoKong commented Mar 23, 2020

Essential cookies

Always active

Analytics cookies

YingxiaoKong commented Mar 22, 2020 •

edited by quantumiracle