Call Scala & Spark code from Python -

-

i have codebase written in scala uses spark. i'd method foo called externally python code.

def foo(a: int, b: string): string

i saw here java python integration can use jython. think that's overkill though.

can't add pyspark method wraps scala/spark existing method?

if not, isn't there simpler solution, wouldn't need special module jython?


Comments

Post a Comment

Popular posts from this blog

github - Git errors while pushing -

-
Image
i input "git add -a" , gives me error: "fatal: unknown index entry format 65540000". i looked every other sources , not figure out means. then, tried pushing using sourcetree , got error below: all added codes , few imagefiles. not sure causing problem. last commit did month ago, btw. first commit after upgraded xcode 7.0 version. thanks this first commit after upgraded xcode 7.0 version then try clone again repo xcode7, , add change in new local repo. should work better in clone entirely managed new xcode.
Read more

php - Using grpc in Laravel, "Class 'Grpc\ChannelCredentials' not found." -

-
i trying use grpc in laravel project. this part of composer.json file: "require": { ... "datto/protobuf-php": "dev-master", "google/auth": "^0.7.0", "grpc/grpc": "dev-release-0_13", ... } i have generated php file proto file. placed in app/services/ , included in composer.json autoload.files section. have run composer install without issues. i have created route testing. has following code: $client = new vat_service\vatserviceclient('localhost:50051', [ 'credentials' => grpc\channelcredentials::createinsecure() ]); but receive response class 'grpc\channelcredentials' not found. when visit route. the laravel app running in homestead vagrant box. i don't know how proceed. missing dependency? did miss install something? i have solved problem, not sure of below steps solution. things tried: i installed grpc-beta in homestead box (...
Read more

c++ - How can I delete a QSharedPointer -

-
i have written wrapper around qtextedit use qiodevice. want able use multiple wrapper same qtextedit, may use different text color each wrapper. to make wrapper thread-safe added qmutex protect usage of qtextedit. thinking must use 1 mutex protect 1 qtextedit. i end following implementation, using qsharedpointer protect qtextedit. texteditiodevice.h class texteditiodevice : public qiodevice { q_object public: texteditiodevice(qtextedit * qtextedit, qcolor color, qobject * parent); virtual ~texteditiodevice(); protected: qint64 readdata(char *data, qint64 maxlen); qint64 writedata(const char *data, qint64 len); private: /** * @brief pointer qtextedit */ qpointer<qtextedit> textedit; /** * @brief text color */ qcolor color; /** * @brief shared pointer qtextedit associated mutex */ qsharedpointer<qmutex> mutex; /** * @brief storage qtextedit associated mutexes */ sta...
Read more