Quantcast
Channel: Active questions tagged redis+java - Stack Overflow
Viewing all articles
Browse latest Browse all 2204

Read data saved by spark redis using Java

$
0
0

I using spark-redis to save Dataset to Redis.Then I read this data by using Spring data redis:

This object I save to redis:

@Getter@Setter@AllArgsConstructor@NoArgsConstructor@Builder@RedisHash("collaborative_filtering")public class RatingResult implements Serializable {    private static final long serialVersionUID = 8755574422193819444L;    @Id    private String id;    @Indexed    private int user;    @Indexed    private String product;    private double productN;    private double rating;    private float prediction;    public static RatingResult convert(Row row) {        int user = row.getAs("user");        String product = row.getAs("product");        double productN = row.getAs("productN");        double rating = row.getAs("rating");        float prediction = row.getAs("prediction");        String id = user + product;        return RatingResult.builder().id(id).user(user).product(product).productN(productN).rating(rating)                .prediction(prediction).build();    }}

Save object by using spark-redis:

JavaRDD<RatingResult> result = ......sparkSession.createDataFrame(result, RatingResult.class).write().format("org.apache.spark.sql.redis")            .option("table", "collaborative_filtering").mode(SaveMode.Overwrite).save();

Repository:

@Repositorypublic interface RatingResultRepository extends JpaRepository<RatingResult, String> {}

I can't read this data have been saved in Redis by using Spring data redis because structure data saved by spark-redis and spring data redis not same (I checked value of keys created by spark-redis and spring data redis are different by using command: redis-cli -p 6379 keys \* and redis-cli hgetall $key)

So how to read this data have been saved using Java or by any library in Java?


Viewing all articles
Browse latest Browse all 2204

Trending Articles



<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>