https://github.com/streamnative/pulsar-spark
Spark Connector to read and write with Pulsar
https://github.com/streamnative/pulsar-spark
Keywords
apache-pulsar apache-spark batch-processing data-processing data-science flink spark spark-sql stream-processing structured-streaming
Keywords from Contributors
catalog apache-flink flink-connector flink-stream-processing pulsar schema-registry measur community transformer archiving
Last synced: about 1 year ago
JSON representation
Acceptance Criteria
- Revelant topics? true
- External users? true
- Open source license? true
- Active? true
- Fork? false
Repository metadata
Spark Connector to read and write with Pulsar
- Host: GitHub
- URL: https://github.com/streamnative/pulsar-spark
- Owner: streamnative
- License: apache-2.0
- Created: 2019-07-01T02:36:19.000Z (about 6 years ago)
- Default Branch: master
- Last Pushed: 2024-04-12T22:26:32.000Z (about 1 year ago)
- Last Synced: 2024-04-13T08:01:15.184Z (about 1 year ago)
- Topics: apache-pulsar, apache-spark, batch-processing, data-processing, data-science, flink, spark, spark-sql, stream-processing, structured-streaming
- Language: Scala
- Homepage:
- Size: 697 KB
- Stars: 109
- Watchers: 35
- Forks: 48
- Open Issues: 11
- Releases: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
- Codeowners: .github/CODEOWNERS
Owner metadata
- Name: StreamNative
- Login: streamnative
- Email:
- Kind: organization
- Description: Cloud-Native streaming data platform powered by Apache Pulsar
- Website: https://streamnative.io
- Location: San Francisco
- Twitter: streamnativeio
- Company:
- Icon url: https://avatars.githubusercontent.com/u/44651383?v=4
- Repositories: 84
- Last ynced at: 2023-03-03T02:45:22.848Z
- Profile URL: https://github.com/streamnative
GitHub Events
Total
- Fork event: 47
- Create event: 92
- Issues event: 107
- Release event: 27
- Watch event: 108
- Delete event: 55
- Member event: 2
- Issue comment event: 249
- Push event: 171
- Public event: 1
- Pull request review event: 205
- Pull request review comment event: 113
- Pull request event: 195
Last Year
- Create event: 38
- Delete event: 28
- Fork event: 4
- Issue comment event: 73
- Issues event: 27
- Member event: 1
- Pull request event: 94
- Pull request review comment event: 67
- Pull request review event: 135
- Push event: 64
- Release event: 9
- Watch event: 13
Committers metadata
Last synced: over 1 year ago
Total Commits: 189
Total Committers: 22
Avg Commits per committer: 8.591
Development Distribution Score (DDS): 0.73
Commits in past year: 46
Committers in past year: 8
Avg Commits per committer in past year: 5.75
Development Distribution Score (DDS) in past year: 0.543
| Name | Commits | |
|---|---|---|
| Sijie Guo | s****e@a****g | 51 |
| Neng Lu | n****u@s****o | 30 |
| Sijie Guo | g****e@g****m | 28 |
| Yijie Shen | h****n@g****m | 19 |
| testbot | s****t@s****o | 16 |
| chaoqin-li1123 | 5****3 | 15 |
| Ting Yuan | t****n@s****o | 4 |
| Lishen Yao | l****o@s****o | 4 |
| amehochan | 1****n | 4 |
| obobj | v****d@g****m | 3 |
| Yufan Sheng | y****n@s****o | 2 |
| atezs82 | a****2@g****m | 2 |
| ericm-db | 1****b | 2 |
| Casey | c****e@g****m | 1 |
| Lishen Yao | y****n@g****m | 1 |
| affe (Yufei Zhang) | y****i@s****o | 1 |
| nathluu | l****s@g****m | 1 |
| honderdzevenduuzend | 1****d | 1 |
| fossabot | b****s@f****o | 1 |
| dependabot[bot] | 4****] | 1 |
| Jeroen Steggink | j****k | 1 |
| tison | w****6@g****m | 1 |
Committer domains:
- streamnative.io: 6
- fossa.io: 1
- apache.org: 1
Issue and Pull Request metadata
Last synced: over 1 year ago
Total issues: 93
Total pull requests: 142
Average time to close issues: about 1 year
Average time to close pull requests: about 2 months
Total issue authors: 41
Total pull request authors: 21
Average comments per issue: 2.19
Average comments per pull request: 1.26
Merged pull request: 125
Bot issues: 0
Bot pull requests: 4
Past year issues: 19
Past year pull requests: 79
Past year average time to close issues: about 2 months
Past year average time to close pull requests: 8 days
Past year issue authors: 13
Past year pull request authors: 11
Past year average comments per issue: 1.37
Past year average comments per pull request: 0.77
Past year merged pull request: 77
Past year bot issues: 0
Past year bot pull requests: 1
Top Issue Authors
- nlu90 (8)
- yebai1105 (6)
- grssam (5)
- mdz-doit (4)
- crazylab (4)
- obobj (4)
- mathieudruart (3)
- syhily (3)
- JTBS (2)
- mnit016 (2)
- Naveen-8451 (2)
- oneebhkhan (2)
- szimon (2)
- timmyyuan (2)
- wenboma100 (2)
Top Pull Request Authors
- nlu90 (50)
- chaoqin-li1123 (27)
- yaalsn (10)
- amehochan (8)
- timmyyuan (8)
- obobj (6)
- atezs82 (6)
- ericm-db (4)
- jianyun8023 (3)
- dependabot[bot] (3)
- imaffe (2)
- honderdzevenduuzend (2)
- hanguyen6 (2)
- nathluu (2)
- syhily (2)
Top Issue Labels
- type/bug (44)
- type/feature (43)
- compute/data-processing (31)
- workflow::todo (6)
- triage/week-16 (4)
- workflow::backlog (2)
- triage/week-3 (2)
- triage/week-15 (2)
- type/question (2)
- triage/week-50 (2)
- help wanted (2)
- workflow::triaged (2)
- component/spark (2)
- triage/week-37 (2)
- P1 (2)
Top Pull Request Labels
- no-need-doc (76)
- doc-info-missing (24)
- doc-required (6)
- compute/data-processing (4)
- dependencies (3)
- type/enhancement (2)
- doc (1)
Package metadata
- Total packages: 2
- Total downloads: unknown
- Total docker downloads: 42
- Total dependent packages: 5 (may contain duplicates)
- Total dependent repositories: 5 (may contain duplicates)
- Total versions: 12
repo1.maven.org: io.streamnative.connectors:pulsar-spark-connector_2.12
The Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
- Homepage: https://pulsar.apache.org
- Documentation: https://appdoc.app/artifact/io.streamnative.connectors/pulsar-spark-connector_2.12/
- Licenses: Apache License, Version 2.0
- Latest release: 3.4.0.3 (published over 1 year ago)
- Last Synced: 2024-05-13T21:22:34.563Z (about 1 year ago)
- Versions: 11
- Dependent Packages: 2
- Dependent Repositories: 2
- Docker Downloads: 42
-
Rankings:
- Docker downloads count: 6.003%
- Dependent repos count: 16.112%
- Average: 19.198%
- Dependent packages count: 23.155%
- Forks count: 24.091%
- Stargazers count: 26.629%
repo1.maven.org: io.streamnative.connectors:pulsar-spark-connector_2.11
The Apache Software Foundation provides support for the Apache community of open-source software projects. The Apache projects are characterized by a collaborative, consensus based development process, an open and pragmatic software license, and a desire to create high quality software that leads the way in its field. We consider ourselves not simply a group of projects sharing a server, but rather a community of developers and users.
- Homepage: http://pulsar.apache.org
- Documentation: https://appdoc.app/artifact/io.streamnative.connectors/pulsar-spark-connector_2.11/
- Licenses: Apache License, Version 2.0
- Latest release: 2.4.5 (published over 3 years ago)
- Last Synced: 2024-05-13T21:41:39.466Z (about 1 year ago)
- Versions: 1
- Dependent Packages: 3
- Dependent Repositories: 3
-
Rankings:
- Dependent repos count: 13.779%
- Dependent packages count: 17.562%
- Average: 20.515%
- Forks count: 24.091%
- Stargazers count: 26.629%
Dependencies
- actions/checkout v2 composite
- streamnative/github-workflow-libraries/doc-label-check master composite
- actions/checkout v2 composite
- actions/setup-java v1 composite
- samuelmeuli/action-maven-publish v1 composite
- org.apache.spark:spark-catalyst_2.12 3.2.2 provided
- org.apache.spark:spark-core_2.12 3.2.2 provided
- org.apache.spark:spark-sql_2.12 3.2.2 provided
- commons-io:commons-io 2.11.0
- org.apache.pulsar:pulsar-client-all 2.10.2
- org.apache.spark:spark-catalyst_2.12 3.2.2 test
- org.apache.spark:spark-core_2.12 3.2.2 test
- org.apache.spark:spark-sql_2.12 3.2.2 test
- org.scalatest:scalatest_2.12 3.2.14 test
Score: 11.848826109692483