Bringing together the Apache Cassandra experts from the community and DataStax.

Want to learn? Have a question? Want to share your expertise? You are in the right place!

Not sure where to begin? Getting Started

 

question

andreasrimmelspacher_189038 avatar image
andreasrimmelspacher_189038 asked andreasrimmelspacher_189038 commented

How can I access nested collections inside a UDF?

@alexandre.dutra may I ask another question concerning the topic... I am struggling figuring out weather my setup is wrong, my syntax is wrong or if it's just not possible. How can I access nested collections, e.g.

  
                 
    
                  
  1. values list<frozen <map<int, int>>>
    2.

I tried:

  
                 
    
                  
  1. List<Map<Integer, Integer>> myList = state.getList(5 , Map.class);
    2.

Leading to:

  
                 
    
                  
  1. Type mismatch: cannot convert from List<Map> to List<Map<Integer,Integer>>
    2.

I tried:

  
                 
    
                  
  1. List<Map<Integer, Integer>> myList = state.getList(5, TypeTokens.mapOf(Integer.class, Integer.class));
    2.

Leading to:

  
                 
    
                  
  1. TypeTokens cannot be resolved
    2.

I am experimenting with Cassandra 3.11.6 and DSE 6.8.0.

I am kind of desperate here...

driverjava
7 comments
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.

alexandre.dutra avatar image alexandre.dutra ♦ ·

The correct version is with TypeTokens. I'm very surprised by the error you got. Are you sure you are importing the com.datastax.driver.core.TypeTokens class? Did you recompile the driver?

0 Likes 0 ·
andreasrimmelspacher_189038 avatar image andreasrimmelspacher_189038 ·

That's what I mean, I am starting to learn Cassandra from scratch and I start doubting my setup.

When I check DSE 6.8.0 folder (installation via binary tarball) I find resources/driver/lib/dse-java-driver-core-1.10.0-dse+20200217.jar. In this .jar I find com.datastax.driver.core.TypeTokens.class.

Furthermore I just skript in cql-shell.

So back to your question: How can I import the class in cql and how can I recompile the driver?

0 Likes 0 ·
alexandre.dutra avatar image alexandre.dutra ♦ andreasrimmelspacher_189038 ·

Import in cql? Sorry I'm getting lost. What are you trying to do exactly? Is the code above from a Java application, or is it from a cqlsh shell session? I think you need to start reading the driver docs now, because you seem to be trying things that developers are not supposed to do, like inspecting the jars contained in DSE 6.8. If you are using Java, you can start reading from here. This page has a section about retrieving collection types. BTW you should upgrade to the latest Java driver 4.6.

0 Likes 0 ·
alexandre.dutra avatar image alexandre.dutra ♦ alexandre.dutra ♦ ·

Sorry I forgot to mention: in old driver versions the class is called TypeTokens, but in 4.6 it is now named GenericType and the method you are looking for is GenericType.mapOf(). Good luck!

0 Likes 0 ·
Show more comments

1 Answer

alexandre.dutra avatar image
alexandre.dutra answered

You must understand that UDF code is compiled and executed in a sandboxed environment, for security reasons.

Because of that, not all Java classes are available inside the UDF body. The official Cassandra documentation explains it, see here.

So in short, Guava's TypeToken API is not available inside an UDF. This makes your UDF very hard to implement, and is a sign that UDFs were not designed to be so complex.

However if you really need it, there is a workaround:

CREATE OR REPLACE FUNCTION my_function (state my_type, name text)
CALLED ON NULL INPUT
RETURNS my_type
LANGUAGE java
AS
$$
  List<Map<Integer, Integer>> myList = (List) state.getObject(5);
  //do something to myList and put it back in state
  state.setList(5, myList);
  return state;
$$;

By using the driver's geObject() method, you avoid the need to reference the TypeToken API.

Share
10 |1000
Toggle Comment visibility. Current Visibility: Viewable by all users

Up to 8 attachments (including images) can be used with a maximum of 1.0 MiB each and 10.0 MiB total.