How to Create a Database in Spark SQL -

-

how create database or multiple databases in sparksql. executing sql spark-sql cli. query in hive create database sample_db not work here. have hadoop 2.7 , spark 1.6 installed on system. 

spark.sql("create database test")  //fetch metadata data catalog. database name listed here spark.catalog.listdatabases.show(false)

Comments

Post a Comment

Popular posts from this blog

django - (fields.E300) Field defines a relation with model 'AbstractEmailUser' which is either not installed, or is abstract -

-
i trying create customuser django project email username , add radio button truck , company. in registration process email-id registered per truck or company. mentioned radio button 'tag' , add manytomany field tag in emailuser model. when makemigrations, raising error : (fields.e300) field defines relation model 'abstractemailuser' either not installed, or abstract. i quite new django , not sure whether have created correct code wants. please me solving this. here code, models.py: import django django.contrib.auth.models import ( abstractbaseuser, baseusermanager, permissionsmixin) django.core.mail import send_mail django.db import models django.utils import timezone django.utils.translation import ugettext_lazy _ class emailusermanager(baseusermanager): """custom manager emailuser.""" def _create_user(self, email, password, is_staff, is_superuser, **extra_fields): """create , save emailus...
Read more

php - Using grpc in Laravel, "Class 'Grpc\ChannelCredentials' not found." -

-
i trying use grpc in laravel project. this part of composer.json file: "require": { ... "datto/protobuf-php": "dev-master", "google/auth": "^0.7.0", "grpc/grpc": "dev-release-0_13", ... } i have generated php file proto file. placed in app/services/ , included in composer.json autoload.files section. have run composer install without issues. i have created route testing. has following code: $client = new vat_service\vatserviceclient('localhost:50051', [ 'credentials' => grpc\channelcredentials::createinsecure() ]); but receive response class 'grpc\channelcredentials' not found. when visit route. the laravel app running in homestead vagrant box. i don't know how proceed. missing dependency? did miss install something? i have solved problem, not sure of below steps solution. things tried: i installed grpc-beta in homestead box (...
Read more

scikit learn - python sklearn KDTree with haversine distance -

-
i try create kd tree of wgs84 coordinates , find neighbors within radius from sklearn.neighbors.dist_metrics import distancemetric sklearn.neighbors.kd_tree import kdtree t = kdtree([[47.8665, 8.90123]], metric=distancemetric.get_metric('haversine')) but following error: valueerror: metric haversinedistance not valid kdtree how can use haversine distance in kd-tree? the k-d-tree can (to best of knowledge) used minkowski norms. there other trees such ball tree in sklearn, or covertree in elki work haversine distance because metric.
Read more