Skip to content
Projects
Groups
Snippets
Help
Loading...
Help
Support
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
E
enoch
Project
Project
Details
Activity
Releases
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Boards
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
DevOps
enoch
Commits
c2caca2c
Commit
c2caca2c
authored
May 22, 2019
by
Node- 门 忠鑫
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
调整consumer结构
parent
66f9fd42
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
12 additions
and
4 deletions
+12
-4
health_message_handler.go
service/consumer/health_message_handler.go
+1
-1
kafka_agent_sarama.go
service/consumer/kafka_agent_sarama.go
+11
-3
No files found.
service/consumer/health_message_handler.go
View file @
c2caca2c
...
@@ -22,7 +22,7 @@ func (HealthMessageHandler) MsgProcess(msg string) {
...
@@ -22,7 +22,7 @@ func (HealthMessageHandler) MsgProcess(msg string) {
err
:=
json
.
Unmarshal
([]
byte
(
msg
),
&
chunkMsg
)
err
:=
json
.
Unmarshal
([]
byte
(
msg
),
&
chunkMsg
)
if
err
!=
nil
{
if
err
!=
nil
{
logger
.
Error
.
Println
(
"healthMessageHandler解析json失败:"
,
err
)
logger
.
Error
.
Println
(
"healthMessageHandler解析json失败:"
,
err
)
logger
.
Error
.
Println
(
[]
byte
(
msg
)
)
logger
.
Error
.
Println
(
msg
)
}
}
buildMsg
(
chunkMsg
)
buildMsg
(
chunkMsg
)
}
}
...
...
service/consumer/kafka_agent_sarama.go
View file @
c2caca2c
...
@@ -7,11 +7,14 @@ import (
...
@@ -7,11 +7,14 @@ import (
"github.com/bsm/sarama-cluster"
"github.com/bsm/sarama-cluster"
"os"
"os"
"os/signal"
"os/signal"
"sync/atomic"
"syscall"
)
)
var
consumerCount
int32
func
AgentClusterConsumer
(
kafkaConf
conf
.
KafkaConf
,
messageHandle
MessageHandler
)
{
func
AgentClusterConsumer
(
kafkaConf
conf
.
KafkaConf
,
messageHandle
MessageHandler
)
{
config
:=
cluster
.
NewConfig
()
config
:=
cluster
.
NewConfig
()
config
.
Consumer
.
Return
.
Errors
=
true
config
.
Consumer
.
Return
.
Errors
=
true
config
.
Consumer
.
Offsets
.
Initial
=
sarama
.
OffsetOldest
config
.
Consumer
.
Offsets
.
Initial
=
sarama
.
OffsetOldest
config
.
Group
.
Return
.
Notifications
=
true
config
.
Group
.
Return
.
Notifications
=
true
...
@@ -20,12 +23,18 @@ func AgentClusterConsumer(kafkaConf conf.KafkaConf, messageHandle MessageHandler
...
@@ -20,12 +23,18 @@ func AgentClusterConsumer(kafkaConf conf.KafkaConf, messageHandle MessageHandler
if
err
!=
nil
{
if
err
!=
nil
{
panic
(
err
)
panic
(
err
)
}
}
atomic
.
AddInt32
(
&
consumerCount
,
1
)
// trap SIGINT to trigger a shutdown.
// trap SIGINT to trigger a shutdown.
signals
:=
make
(
chan
os
.
Signal
,
1
)
signals
:=
make
(
chan
os
.
Signal
,
1
)
signal
.
Notify
(
signals
,
os
.
Interrupt
)
signal
.
Notify
(
signals
,
syscall
.
SIGTERM
,
syscall
.
SIGINT
,
os
.
Interrupt
)
defer
func
()
{
defer
func
()
{
_
=
consumer
.
Close
()
_
=
consumer
.
Close
()
atomic
.
AddInt32
(
&
consumerCount
,
-
1
)
logger
.
Info
.
Println
(
"consumer结束"
)
if
consumerCount
==
0
{
os
.
Exit
(
0
)
}
}()
}()
// consume errors
// consume errors
...
@@ -55,5 +64,4 @@ func AgentClusterConsumer(kafkaConf conf.KafkaConf, messageHandle MessageHandler
...
@@ -55,5 +64,4 @@ func AgentClusterConsumer(kafkaConf conf.KafkaConf, messageHandle MessageHandler
return
return
}
}
}
}
}
}
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment