X Tutup
The Wayback Machine - https://web.archive.org/web/20210121065035/https://github.com/apache/storm/pull/3217
Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

STORM-3590: Adds test to validate that GRAS's node sort is stable and… #3217

Open
wants to merge 1 commit into
base: master
from

Conversation

@govind-menon
Copy link
Contributor

@govind-menon govind-menon commented Feb 26, 2020

… prevents starvation and fragmentation

@govind-menon govind-menon force-pushed the govind-menon:STORM-3590 branch 4 times, most recently from e46f60b to 97d90bf Feb 26, 2020
// schedule gpu topology
scheduler.schedule(topologies, cluster);

cluster.addTopologyToClusterToBeScheduled(createTestStormTopology(stormTopologyNoGpu, 10, noGpu, nonGpuconf));

This comment has been minimized.

@Ethanlm

Ethanlm Feb 26, 2020
Contributor

It doesn't look like a good idea to add a new function in the regular code solely for unit test. We don't need to add this function to achieve what we want. We can follow this https://github.com/apache/storm/blob/master/storm-server/src/test/java/org/apache/storm/scheduler/resource/TestResourceAwareScheduler.java#L504-L511

…prevents starvation and fragmentation
@govind-menon govind-menon force-pushed the govind-menon:STORM-3590 branch from 97d90bf to dbb1d42 Feb 27, 2020
@@ -76,6 +76,14 @@ public Topologies(Topologies src) {
return ret;
}

public void addTopology(TopologyDetails details) {

This comment has been minimized.

@kishorvpatil

kishorvpatil Mar 4, 2020
Contributor

This is supposed to be immutable class. just create another instance of topologies using constructor.

This comment has been minimized.

@Ethanlm

Ethanlm Apr 2, 2020
Contributor

We shouldn't add methods to regular code while it's only used in unit test

// schedule gpu topology
scheduler.schedule(topologies, cluster);

topologies.addTopology(createTestStormTopology(stormTopologyNoGpu, 10, noGpu, nonGpuconf));

This comment has been minimized.

@kishorvpatil

kishorvpatil Mar 4, 2020
Contributor

This is supposed to be immutable class. just create another instance of topologies using constructor.

try Topologies topologies = new Topologies(topo[0], topo[1]);

@@ -76,6 +76,14 @@ public Topologies(Topologies src) {
return ret;
}

public void addTopology(TopologyDetails details) {

This comment has been minimized.

@Ethanlm

Ethanlm Apr 2, 2020
Contributor

We shouldn't add methods to regular code while it's only used in unit test


// should schedule gpu and noGpu successfully
scheduler = new ResourceAwareScheduler();
nonGpuconf.put(DaemonConfig.RESOURCE_AWARE_SCHEDULER_MAX_TOPOLOGY_SCHEDULING_ATTEMPTS, 1); // allows no evictions

This comment has been minimized.

@Ethanlm

Ethanlm Apr 2, 2020
Contributor

This is not able to indicate if eviction happens or not.
Waiting on #3213 so we can have a right way to detect eviction.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked issues

Successfully merging this pull request may close these issues.

None yet

3 participants
You can’t perform that action at this time.
X Tutup