java - 如何从 Hazelcast 的 Imap 中检索序列化对象？

Question

下面的代码用于将 kryo 序列化对象放入 Hazelcast 的 Imap 实例中，然后进行检索。在检索对象时，它会抛出一个错误，名为:

com.hazelcast.nio.serialization.HazelcastSerializationException: com.esotericsoftware.kryo.KryoException: java.io.EOFException: Unexpected end of ZLIB input stream

下面给出了我的代码。

package hazelcast2;

import java.util.Scanner;

import com.hazelcast.client.config.ClientConfig;
import com.hazelcast.config.Config;
import com.hazelcast.config.InMemoryFormat;
import com.hazelcast.config.MapConfig;
import com.hazelcast.config.SerializerConfig;
import com.hazelcast.core.Hazelcast;
import com.hazelcast.core.HazelcastInstance;
import com.hazelcast.core.IMap;
import com.hazelcast.core.ISet;


public class zlibtry {
    public static Config config;
    public static ClientConfig cfg;
    public static HazelcastInstance hz;
    public static IMap<String,MyDataObject> mapItemCount; 
    
    public static void main(String[] args) throws Exception{
//      Scanner obj = new Scanner(System.in);
        config= new Config();
    
        config.setProperty("hazelcast.elastic.memory.enabled" , "true");
        config.setProperty("hazelcast.elastic.memory.total.size", "60G");
        config.setProperty("hazelcast.elastic.memory.chunk.size","2");
        MapConfig mapConfig = new MapConfig();
        mapConfig.setInMemoryFormat( InMemoryFormat.OBJECT );
        //config.getNetworkConfig().setPort(5701);
        //config.getNetworkConfig().setPublicAddress("127.0.0.1"); 
        config.setProperty("address","127.0.0.1");
        
        SerializerConfig productSerializer = new SerializerConfig()
         .setTypeClass(MyDataObject.class).setImplementation(new ProductKryoSerializer(true));
        config.getSerializationConfig().addSerializerConfig(productSerializer);

        hz=Hazelcast.newHazelcastInstance(config);

         mapItemCount=hz.getMap("objectMap");
         
         MyDataObject obj = new MyDataObject();
         
         ISet<Integer> iset = hz.getSet("zlibset2");
         iset.add(1);
         
         obj.setMyList(iset);
         
         mapItemCount.put("1", obj);
         
         System.out.println(mapItemCount.get("1").getMyList().toString());
         
         
         
         
         
    }   
}

以下代码适用于productKyroSerializer:

import java.io.ByteArrayOutputStream;
import java.io.IOException;
import java.io.InputStream;
import java.io.OutputStream;
import java.util.zip.DeflaterOutputStream;
import java.util.zip.InflaterInputStream;

import com.esotericsoftware.kryo.Kryo;
import com.esotericsoftware.kryo.io.Input;
import com.esotericsoftware.kryo.io.Output;
import com.hazelcast.nio.ObjectDataInput;
import com.hazelcast.nio.ObjectDataOutput;
import com.hazelcast.nio.serialization.StreamSerializer;

public class ProductKryoSerializer implements StreamSerializer {
    private final boolean compress;

    private static final ThreadLocal<Kryo> kryoThreadLocal 
           = new ThreadLocal<Kryo>() {
        
        @Override
        protected Kryo initialValue() {
            Kryo kryo = new Kryo();
            kryo.register(MyDataObject.class);
            return kryo;
        }
    };

    public ProductKryoSerializer(boolean compress) {
        this.compress = compress;
    }

    public int getTypeId() {
        return 2;
    }

    public void write(ObjectDataOutput objectDataOutput, MyDataObject product) 
           throws IOException {
        Kryo kryo = kryoThreadLocal.get();

        if (compress) {
            ByteArrayOutputStream byteArrayOutputStream = 
                new ByteArrayOutputStream(16384);
            DeflaterOutputStream deflaterOutputStream = 
                new DeflaterOutputStream(byteArrayOutputStream);
            Output output = new Output(deflaterOutputStream);
            kryo.writeObject(output, product);
            output.close();

            byte[] bytes = byteArrayOutputStream.toByteArray();
            objectDataOutput.write(bytes);
        } else {
            Output output = new Output((OutputStream) objectDataOutput);
            kryo.writeObject(output, product);
            output.flush();
        }
    }

    public MyDataObject read(ObjectDataInput objectDataInput) 
           throws IOException {
        InputStream in = (InputStream) objectDataInput;
        if (compress) {
            in = new InflaterInputStream(in);
        }
        Input input = new Input(in);
        Kryo kryo = kryoThreadLocal.get();
        return kryo.readObject(input, MyDataObject.class);
    }

    public void destroy() {
    }

//  @Override
//  public Object read(ObjectDataInput arg0) throws IOException {
//      // TODO Auto-generated method stub
//      return null;
//  }

    public void write(ObjectDataOutput arg0, Object arg1) throws IOException {
        // TODO Auto-generated method stub
        
    }
}

此外，我认为应该有一些适当的方法来在反序列化后检索对象。

您可以看到“objectMap”hazelcast 的 IMap 实例，我已经更新了 hazelcast.xml 中的一些代码:

<map name="objectMap">
    <in-memory-format>OBJECT</in-memory-format>
</map>

<map name="cachedMap">
    <in-memory-format>CACHED</in-memory-format>
</map>

<map name="binaryMap">
    <in-memory-format>BINARY</in-memory-format>
</map>

myDataObject 的代码是

import com.hazelcast.core.IList;
import com.hazelcast.core.ISet;

public class MyDataObject {
ISet<Integer> myList;

public ISet<Integer> getMyList() {
    return myList;
}

public void setMyList(ISet<Integer> myList) {
    this.myList = myList;
}

}

Answer 1

ISet 不可序列化，并且不能直接序列化为类内部的字段。请参阅以下代码片段以了解可能的解决方案。

public class MyDataObject
    implements KryoSerializable, HazelcastInstanceAware {

  private ISet<Integer> myList;
  private String myListName;

  public ISet<Integer> getMyList() {
    return myList;
  }

  public void setMyList(ISet<Integer> myList) {
    this.myList = myList;
    this.myListName = myList.getName();
  }

  public void write (Kryo kryo, Output output) {
    output.writeString(myListName);
  }

  public void read (Kryo kryo, Input input) {
    this.myListName = input.readString();
  }

  public void setHazelcastInstance(HazelcastInstance hazelcastInstance) {
    this.myList = hazelcastInstance.getSet(myListName);
  }
}

我想这应该可行(至少是;-))只需在浏览器中编写它即可。