python - 具有keras和多个序列的时间序列预测

Question

我理解在一个序列上keras中的stateful LSTM prediction example。这个例子有一个5万次观测的序列。
我的问题：
如果你想训练5万次观测的多个序列呢？假设一个以不同的值开始/结束并且有稍微不同的行为？
如何修改示例以增加预测时间步长？
LSTM对这类事情有好处吗？
完全可复制的例子，3个平均回复时间序列和预测20步。

# generate random data
import statsmodels.api as sm
import numpy as np
import pandas as pd

cfg_t_total = 25000
cfg_t_step = 20
cfg_batch_size = 100

np.random.seed(12345)
arparams = np.array([.75, -.25])
maparams = np.array([.65, .35])
ar = np.r_[1, -arparams] # add zero-lag and negate
ma = np.r_[1, maparams] # add zero-lag
y0 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)
y1 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)
y2 = sm.tsa.arma_generate_sample(ar, ma, cfg_t_total)

df=pd.DataFrame({'a':y0,'b':y1,'c':y2})

df.head(100).plot()

df.head(5)

# create training data format
X = df.unstack()
y = X.groupby(level=0).shift(-cfg_t_step)

idx_keep = ~(y.isnull())
X = X.ix[idx_keep]
y = y.ix[idx_keep]

from keras.models import Sequential
from keras.layers import Dense, LSTM

# LSTM taken from https://github.com/fchollet/keras/blob/master/examples/stateful_lstm.py
# how to do this...?!
print('Creating Model')
model = Sequential()
model.add(LSTM(50,
               batch_input_shape=(cfg_batch_size, cfg_t_step, 1),
               return_sequences=True,
               stateful=True))
model.add(LSTM(50,
               batch_input_shape=(cfg_batch_size, cfg_t_step, 1),
               return_sequences=False,
               stateful=True))
model.add(Dense(1))
model.compile(loss='mse', optimizer='rmsprop')

model.fit(X, y, batch_size=cfg_batch_size, verbose=2, validation_split=0.25, nb_epoch=1, shuffle=False)

Answer 1

看看菲利普·雷米的这篇文章。它解释了如何在keras中使用有状态lstms。