Right database for storing large amounts of entity relationship data -

-

i'm trying choose database suits use case. here simple example of i'm trying store in database:

lets say, have 'users' , 'groups'. each user can part of number of groups. there hierarchy in groups ie.. each group can have multiple child groups.(and child groups can again have grandchildren , on...)

requirements:

  • i adding multiple users parent group , should automatically added child groups.. so, have child groups of given group , add these users every 1 of them. operation should atomic.
  • i have multiple threads running in parallel updating groups & adding users them. don't want race conditions.

if go rdbms approach, have user table, group table , relationship tables user-group mapping , parentgroup-childgroup mapping. able handle requirements using transactions/locks etc..

but, - number of users going few million , each user on average part of couple of hundred groups , height of group hierarchy tree less(<20), relationship tables going really big. - data stored in user table unstructured.

from understand,

nosql databases can handle scale , unstructured data don't provide acid features need , sql databases not handling large amounts of data.

i don't need complex graph traversal queries expect 1 mentioned above. need simple queries getting users in group, getting groups user etc.. these queries should fast.

so, correct database use case??


Comments

Post a Comment

Popular posts from this blog

Python Pandas join aggregated tables -

-
i have data frame 2 columns: product_id , rating. i'm trying join 2 tables. 1 obtained from a = data.groupby('product_id').count() the other one b = data.groupby('product_id').mean() i'd have table has on columns the product_id count mean try: data.groupby('product_id').agg(['mean', 'count'])
Read more

process - Python What is the difference between a Pool of worker processes and just running multiple Processes? -

-
i not sure when use pool of workers vs multiple processes. processes = [] m in range(1,5): p = process(target=some_function) p.start() processes.append(p) p in processes: p.join() vs if __name__ == '__main__': # start 4 worker processes pool(processes=4) pool: pool_outputs = pool.map(another_function, inputs) as says on pymotw : the pool class can used manage fixed number of workers simple cases work done can broken , distributed between workers independently. the return values jobs collected , returned list. the pool arguments include number of processes , function run when starting task process (invoked once per child). please have @ examples given there better understand application, functionalities , parameters. basically pool helper, easing management of processes (workers) in cases need consume common input data, process in parallel , produce joint output. the pool quite few thi...
Read more

java - Static nested class instance -

-
this question has answer here: java inner class , static nested class 23 answers i came across in java, know static nested class why create instance of 'static'. isn't whole idea of 'static' use without instance? understand concept of inner classes, why (and frankly how possible to) create 'instance' of 'static' member @ ? why this: 1- outerclass.staticnestedclass nestedobject = new outerclass.staticnestedclass(); 2- nestedobject.anestedclassmethod(); and not this: 1- outerclass outerinstance=new outerclass(); 2- outerinstance.staticnestedclass.anestedclassmethod(); use on inner classes, keyword static indicates can access inner class without instance of outer class. for example: public class outer { public static class inner { /* code here. */ } } with construction, can create instance of inn...
Read more